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(57) Abstract A 

During a write processing for channels 
(Chi, Ch2, Ch3), the end limit of each 
channel is set according to the transfer rate 
varying with the ratio of the number of 
effective packets to that of dummy packets, 
and end limit information is written on a disk 
along with write data. In a read processing 
for the channel (Ch4), the end limit is set 
according to the end limit information which 
is read out of the disk along with read data. 
Processings of earlier end limits are carried 
out in order. Considering the difference 
between the transfer rates at the outer and 
inner peripheries of the disk, a write zone is 
determined. When simultaneous recording 
for the channels (Chi, Ch2) on an ASMO of 
groove/land recording system is carried out, 
data through the channel (Chi) are recorded 
along grooves and data through the channel 
(Ch2) are recorded along lands, sequentially. 
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Experts Group phase 2 ) ^ <£> lb ® ^Hfc / ft ^-ffc L S I (Large 
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3Sg£(DHfc^^r-^ JIG B tEiLTlit^ 

)^S*$tlSCtH&«. ^OiaftttSCft, 1ft, STB, 

i$nTl>5V>^7i-XC, I E E E (Institute of Electrical 
and Electronic Engineers) 1 3 9 4 £. Vfr It tl %> ft M <D is V T )\/ 4 
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ft* © X V yi-^^TJ^'UXAtLTll, # (7) J; 5 %> <7) 
io Wmvf*>tlZ> (A. L. N. Reddy and J. C. Wyllie, "I/O Issues in 
a Multimedia System " , Computer, 27, Mar, pp. 69-74, 1994. )„ 
(1) EDF (Earliest Deadline First ) : ^T$!8g (deadline) 
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"f— 9 . -fay 9 • /t^r-y h 4 Ctt, IEEE1 3 9 4 ®Ay^ 
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£7c. ±J£L/fc (1) ~ (5) ©X^rya-U >^tt, ^ftlfe 
It5*^, zs- Zmffl&frfrZ Z. £ifi& < . Iff S L < diVi. 

(h7'^©i^) (c^fiju, ^ x * ©latefiiw^sct Li, z 

CAV (Zone Constant Angular Veloci ty) £ M T Z> Z t \Z «k 0 , 

* LTWz&^nfcm&iztemmmm&m < & o . 

© ^ * > ;P © M 3 tC ^ $ £ v> -5 ^ H $> o o 

tLTASMO (Advanced Storage Management Optocal disc) ifi 
&M £ *IT ^ & . ASMOIt If^lJi©ilMT^7^T$ 
t) , illl 2 Offlm O^f $Tfrf 3fc0«±6. 1GB (^f iS /X 

0 5 CASMO©Ifijc^it„ 

0 {'^Tct 3 , A S MO^te. 7 > H (til) lit 7)1—7 
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77 3U~cfc <0 ^lilt$0oT^S. 7> F 1 It Cf)l-7° 1 2 <D t° 
5^— ^fBfifefgt^ (recording area) 1 30i^liO. 6 na 

h 7 <y ^ Hf X ^ ± l: «JS!« I: « j$ S MT . . 

10 ^w' ^^Ox — ^^SB»$nTV^^4«^SB 1 7 CD 

J? 2 « 1 . 2 mm tC L T ab 5 o 

£*ITU£. ^LT, #b^y^7te, I.£ti0 7l/-A14(;^l 
SftTU-5. 7 1/-A1 4te>tt^CDiz^*>MC#»J£ftT:fcD> 
15 1^.' Jfe||©t^A>hS7Hl/^ty^>h (ADR S ) 1 5i 

vkZnrzZ n y V? — V 1 7 # 19! e> n T V* . 

10©7^-AI 4©ir-^t^^>M 6Ctt, 2 
20 KB (^ n A'-f h ) Cr-^tECC (Er ror Correc 
t ing Code) #*g3fi* £ ft S . * , 7K1/Xt^/>M 
5 fete, 7h^x«8, j-)VYn$->. y)T>y')V, v+f-z? 
mrftZmZtL&o 7HI/Xt^^>hl 5Ttt, <Lft£><Dli38^\ 

25 obble) ^JST. l5fc($-5, Jt#J £ * :/;UTSB£]fc $ ftT l> -5 . 



WO 00/42515 



PCT/JP99/05679 



10 

¥rm^ * y* )VT H l/X (Singled Sided Wobbled Address) 1 8 it . 
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-f * □ ;* - h ;p T & 5 o 
± i& b £ 5 fc: , ASMOli, ^iwi:2 2i©y-x:^|j$ 

fl'HC II 1 /- > (Logical Zone) N^'tt.Il/- >M+2) JTO. 
10 7 1 4lCDSiy->C^ta$ns. 0 6 tC *3 . 

mV— >N~M + 2 (DftmiZitrt v 7 T P^<Df £ — $ g <E> B$ Pel #J l£ 
*iLTU5. HBKCCT^ftltt. ASMOOil 1 /->N~iiy 

15 + 2 ^ £ 7 — ^ £ A* y 7 7 \Z Mfr iK'TWISl/ TV^„ d 

^ y F At^S©jliy - > N + 1 j&> 5^S©iiy->M + 2 * T 

:oii i /->N + i &7^txLT^^. ii i ;->m 

ilOlfgtl^!;, A-y7 7^e>^a5iIl:ttlMB ( * # A h ) 
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U y tf > 9 - U 7° I/ — X * > h (SI ipping Replacement : SR) t. 
U ~ 7 U y I/ — X ;* > h (Linear Replacement : L R ) 
£ c SRte, * RS -fe ^ ^ £ L T , ^W-fe ? ^ K^-* 
15 IBfiibT^ < 3f & T & £ „ 7^7I'J7i:tt. ESt- 

H7i:tt, S RtLRO^fe^I ^ W id $ tl T I'* -2> <> (1) 
20 SRSiL. (2) ~ (4) ^LR^iltl^, LRHH31I 

(2) « R - f& Jg V* - > ft (D X ^ 7 X U 7 T ^ 1% iz ^ ^ £ 3£ # T 

( 3 ) teffi^fSsSV - X ^7 X U7T*P(S-te^*£3£#T 

25 %>?3m. 
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(4) }$m&-r zmmv- >\h<dx^7 x.*) y-cw&±2?*£. 

ZCD^^iZ, ASMOfl mm s /~ ><D !f)V—Zf £ ? > F 
5 U^7IU7) £t£tt3 Z. £. \Z cfc D > MTLs 

7->tt8MBiSTfeD, 1^©|11 > /->I; 1 ifcir./->tt 3-' 

o~5 oi@t*tJn§. 

10 ilV- XDffimte. m 8 (C^-Tcfc 5 it . s\y F*#: 

* Hi T 3 > - * «j ^ £ ff-fe ftfc, ^il/>X3 OOlilCkS 

2 o o hz> v &mmizi,TmmzrLT^z> 0 mmiz&^x 
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15 f §y P v $ 3 2 £ om^Mtf 2 .0 0 h zr v Z ) T & -5 ^ £ £ 
*IT(^3 0 d <£>*f #1 >X 3 0 C ck -5 7t ^ COifi^ te> **5ms 

_h f B 3£ -> - <h |WU£ & 2 0 0 h^-y^co^S^ffofcJ»^^^, 

20 ASMOC^^Ttt, V— >cr>4»«, JK S'J #J iZ i/ — >T 

mm±^- ?mM(D&miz£z>7 ? -txw-zmmiz i®x&z> a z\ 
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CD, 3. 5<>?MO0I^, rt^OjA^M «k D fefeiHj$S*<il 

ts.E<DfBimifi*>-3fr. Z\(DmmiZ* HDD (Hard Disk Drive) \Z& 

®<Egc.£^ffc ZCLV 
(Zone Constant Linear Ve 1 oc i ty) £ ^ffl L T l> -5 a£> , 3. 5 -f 

> ^ m o (D m & <n <t -5 & n m it m £ l & i> , v - > p B ^ £ # ? 
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u®i^llff-ri>«fc?&7yya-;p*igtts. fit, tap ^ 

25 St*tB L^S©Hfr^MfflJ-r *. 
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> ~> ^ ji/ k # # tr $d p $ ff ? o 

fl? # J£ 1 2 . ; &»^jA^^^©«^^^.a ? 

"r — ^ rt* £ £ 66 T :> — f > ~> * )Hzm % & tl , ^ ^ (D 

M?H£. m 1 (DXlriSjL— U >^l£ 1 1 ^fc^D^^^g: 1 3 fi. 
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L/ , 4(1 » 3= g: 1 2 MPU31, LS I 32, H 7 -f A*®g& 3 3 , 

mmiR-z nfzik%i<DV- >\zkm • iB^$n^«t o izm 

^©i^^J^tXMiSllCcfcntf, IB ® CD IS 31 

-r £ £ £ ^ T? # S o 

*fii©^4©jiit t kn«, 7 * * 4d fa? g s « , zc 
a v k s ^ # tu fefifij » ff t) n 5 n&mft\ztt-r § * > * ^ 

(D|WlBtlB®*$!llBI'r^T^-trX^lfflI^«$:Huif<hL, 

&miR2ntztii&<DV->izmifctiL3k : ?Y>*j\'<D7 : -?&ft 
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17 

it , >*)v<o i r-* & mm%n<D v - > \z ft m. • mm-?z><D 

5 § V— >n©A y H W^»B#P B 1?rlJD5|c LT, MIS 

h& SB <W r >*;K£>-r- ^ iwi — <DV— >tc3cStc 

3 Rtxm 4 <omm<DT ? ■kxMfflmm.iz&\,*-c . miz. &zv—> 
T?>g'j^^©<h, BofB^-^ >^;KD^-^^giji^^nfeHuiBy-> 



WO 00/42515 



PCT/JP99/05679 



18 

m*k&»imizf3L2> 0 

15 -5 „ 

§B ft J&* a] m iZ -5 o 

bu IB & ^ > ^ ;KD — ^ ^ , ifc 5t £ n 2t T £ 7 > K £ £ tt 

^-yic^T^m • fB^^n^>ct^f3$ijfflit-5$(Jtaf#at^{i 

25 ^-5o 
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'9 

\ >^;i/©T f - 9 ffi. mmv— ? > h t >f)v—7\z 
&Kizftm • iB&sn^j; o legits. 

io sfc, *^?g<D^ 9 <omm\z &tu£ , j^txnigitt, ±i2 
&8<Dmm<DT2±Lxfflw^wiz&\,*T* si;, ^^>^^>^;kd 

x-* ©BUBfc^&SW- -^©^-v > ^ ;K7) ^ - ^ 

<fc » M 7 > H * 7° <h M (3 & -3 T tr> £ CD 7 > h* * fz \t 

15 fl&<D2/^ — znzfZm-gtlT^&BiKD^* >*)V<D^— 9 

> ^ IS: £ i/i S . 

COiei^T^tXMigiflcfcn^, ^ * > * 5* — * © BU Rfc 

20 ^mworn i o ©M3K3j:ntt\ yn^sigia, ± 
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20 



m 1 « , 5fc <£> 7^ 7 V 7. >T v =l — U >^S:*tiTS^o 

i2(t —feu- h cDfej^^-^ eit& 
gun ra^feit^^-riiiT^ ^>c 

El 6 te, AS M0^43^§^Sy->(7)^^^^-rillTS-5„ 

hi 7 a s mo \z%> n ^xm^m^mftysm *m.m-r s ei-c& 
isti, a s mo iz&vz>u>xm ft <d ?>.\z & z> t mm 

I 9 11, ASMOl;^lt§Wr i t e Wl ft £ m W f Z> El Tf & Z> . 
HI 1 0 , A S M O iz *3 tf Z> R e a d f£ £ 91 ~T £ EI Tr & -5 0 
Ell 1 te, *%Hj(oy/7-feX$ii'#^McDi^SIEIT$)>5o 

B 1 2 li, XhU-yy7rA0i^@t*§. 

Si 3 , ? << 7 9 7. *r v =l — V > <n m.W7 u — ^ - b -e & 

So 

0 1 4 « , ^l(D7 ? ^X^7.^^3.- , J>^^^-ri2IT^'5 0 

igi 5 j 7.5 izmmz nz>^-? <d 7 * - v y h ^^ti 

Ell 6 fi , g20r^7^X^rya- 'J > ^ £ EI T & £ <, 

II 7li. X^ya-^r-^;^*tlf^^. 
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Bl'9 14, ME ta l m m <D y u — J- ^ - h T & Z> o 

g 2 2 tt,. 2 ©t^t^.7;M U XA^it 
5 0 2 3 tt, ■ f 1 O 4 /- >ft£ja.lOJgl 7 □ - ? t - h 5 . 
0 2 4 tt,-.JS 2 ©7->fttMlOll7 D— — ht^^o 

B2 5I4. HL& s s->t Grammy— b &m-rm-v&z> 0 

0 2 7 it , ?t>^;H:i:i^<f tii*®l©7n-f t-h 
io T & £ o 

12 811 y->*f^ffl^fctt)A^®l(07n-5 : t-hT$ 
5. 

o 3 o n mm^n tf^ &<DfeMmffi&*k-rmT*fc & 0 

15 13 lit ASMO$3 90il7->l;^#JLfc^i^^ti 
T -5 o 

03 2 « , 0 3 lCStASMOClf ir>*;KDr- 9 &Um. 
1-^Jffi^it0tSD> (a) «mSV->> (b) \X>f)V-y\ 
( c ) tt^ > H iI^^TlBtt5^SSStiT$§. 
20 0 3 3I1, 03 1 i:StASMOIl2 5 L f >^;P©f-^£IEi 

0 3 4ii, 131l:STAS MO f~ 2 5^ ^ > * )V <D — 9 £: 1^1 P# 
25 ~€ $> <0 > (a) tt^^W 2 ^ >^ JHWIBtfB^, (b) ttC h 2 (Dffl 
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m . ( c ) it C h 1 <D i3 — ^ 5? n 2 is a > , ( d ) 'St # - ^ 5? n ^ 
v a >I(DCh 3, 4<D2'3 L *>*;i'l^l$ffi«a>:£fe&5K-r0T* 

B3 5U, *f6^»c*s^* 7 > h • sow -7 # it ©k» 

0 3 6 tt. Z C A Vjj&vm&fflmjfi&O^J 7.2 <DV—>ftm 

10 03 7(i, 0 3 6 ©-x^ X # ic^TS 2 3^ >^;KD|h|R# BH&K: 
^^•SMScD^fe^^-rill-eafeD, ( a) ttC h 1 , 2 (D HO B# f B fiK 
Ch 2 (Dmm. ( b ) eChl®A , -^i?^i/ 3 > 1 (c) ^ # 

15 mm^m-f 7 a — * — h * . 

@3 9 « , 4 7 7 <DQ%"/- y&M&i-t Z>7 )U3 i) X A&MW 
t57D-ft-h (^©1) T'$5. 

t57o-ft-F (f©2) T&£ 0 
20 04 lit 7 h'J-A^f lt5r-^;K5«)S0iJ^^ti-CS 

. I4 3H, 0 3 6 ©5 s W X ^7 (D&V— 
25 0 4 4 IJ. i3 9Rt;i4 0©7D-?t-hOMIC^it5X 
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5 i46H 043 <D'J- >Mf&<D'r ^ X ^ , 0 3 9 ft-tf 0 4 0 

04 7 tt, 04 3O 4 /->il*0T>f7^1:,'i3 9 $:££0 4 0 
(D y p — 5=--^ — h^^-TMS^HfTLfc^'&co, ir^X^OX h 
10 'J-Ax-^©l5if (^CD2) 

I4 8it 0 4 3 ©7 - >«ric<0-5r-f X , 0 3 9 SlD^'0 4 0 
O^D — - htC^-r^S&^f^Lfc^'&O, X? <DX h 

u - Af- 9 (Dumw^mcom^^^tm (^©3) 

S4 9tt. 0 4 3 ©7- >ifi£(?)T^ X 2 iZ, 13 9Stfl40 

■j - A?—?<DmmBm<Dm&&^Tm 4) t*s. 

1 5 0 (1, 04 3© k /->«f£©f^7^fC. i3 9R^H40 

'j <Dmm&m<Dm&&^-rm (f©5) 

20 1 5 lit 1430 V— >ffi!&<D^s( XZ \Z. 0 3 9 RZSm 4 0 

(7) ^ d — ^ — b iz^jkTmm^^vr L-r^m-to) . ^ xz <dx h 

25 
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s 5 3 (t is 2ii^ty->i^©f'f 7^n, t % ± x m m 

R & 5=- ^ > * )V m. £ # H b & T* 2 ^ ^ > * ;W © 1^ 8B M £ ft 5 ^ 
^&U£BJf-50-ea5O, (a) ay->i t7->2i;^f -gi 
(b) tt7->10^C^t - IBit5«sj v (c) (iy-> 

B5 4tt, 05 2(:^t , ;->i^©f^x^(: > TZ'txmm 

& % n l & t* 2 ^ r > * ;u <d m is ib & & n v Jj m & m m -r « 0 t 
a5o, (a) \zv—> 2 £ v-> 3 • mmr&m. (b) rav 

- > lro^C^t • SB & ( c ) it V — > 5 <h .v/ - > 6 \Z ft 

gi5 5«> si 5 2 ic^-r v— >«/£©5 j >f x 9 \z, Tz-txmm 
s^f t>^jn^tiii, 2 > *)i<Dmmmm$:ff? urn 

( a ) tt 1/ - > 2 <h V - > 3 # WL • IB @ T 

3#y> ( b ) 1 l v-> 2 i^t* • tzm?z>m\ (c) «v 

15 -> 5 £V- > 6 SBS-rSWTfc*. ■ 

20 »/— >&mn lt«&^-*- >*)i><Dmmtzm&no tjuj u xa £ 

>s - > & m & v x m & ^ * > * )i (D mmmm & ?f z> 7 a 3 >j x a 
25 1 5 9 n, m&m&&mizi$i,xM'£&m&Mtfm% <ko \z&m. 
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9k-?7 U— 5^^ — h ( CO 4 ) & 5 o 

0 6 o z c l vcoiiiteaiJ^^^cD^V x ^ tcftlfr^-r >*;u 

5 

io nxiisiits. 

t4Ki, -%:<Dmx (Dmmu- h iz ^.c-cm&o^zm m^-ta 

20 9 4 2I±. sS^n^X^^a.-Jl/tc^ T, ^ti £ ©«^&#-/ 

z\<djz o ^ izxmmmmiz^nu. mmcD&mu- b\zm^ 
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io > ;u K # ^ & tf Mflf £ fr 5 o 

cKDcfca^T^-trx^p^Mfcfcti^, it & ^ * * ^® m. f - 
i i coxyvoL-'j >^fg4 i *j;^fa4 3 &&-r* 

@ 1 2 ©MPU (T-f^D^Pt'yii'i-f M 6 $0 
I?g4 2lt MPU61, LSI 62, K 7 -f A* 0 S§ 6 3 , 43 £ 
I/A •;77^t'J6 4 (C^fJ^f £0 
25 J^T. 0®£#H8L&:j&«e>, *%^omfi©^S8€:^«l»cK^-r 
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So 

* f£ 93 \z £ v> X , S # M -o tz. U m. /1 tr v h1)\*># 5.— • i\*x v 

81 IB'* iH tfc £ K 5 £ £ T , X^rya-'J > ^ CD P# p B 1 ft9 #?ig 

20 yyXrAOi^0T*3b5. 0 1 2 ©7 M/-y y X t A(i, 7f 
I^-vtA^ 5 1. STB 5 2. ^i^'ry^f T V 5 3 £41*. 
^tl6CD#^S«I EEE 1 3 9 4 IeJ£! 5 4 K: «k 0'S t,* ItZ&M. £ tl 
TV* -5, STB52H, #J*.te\ ^g|5©^-y K7-^^bMPEG 

25 5 1 lZ&m-?Z> 0 fit, rv^iHV 5 3 11, X b l/-yf;H 
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x 2 5 izfcwz hfc m& ? *m.&m lt, mm i:isr§. 

X h U — 75 1 \Z&^X, "r 4 7.9 7 9 ± X <D M '0 £ fT 
-5 [s]SS«, f-fX^7 57 t^HifflM PU6 l.(70Dynt»; 
Ij- - y h ) , IEEE1394LSI62, f^fX^ H^'f A'6 
5 3, *«k^y7 7^ : E , j6 4St*, un5©SgSll/U'6 5 

L S I 6 2 li, 016 4 h U -yfAWT, 5 1 CO ffl O ® ft -f 

>^7x-Xt iTftf^TS. A'7 7 7« l J6 4ii, #| fc£ % 6 
4^D/H F (KB) ©gl&ftS 1 BfiCDM^D^^ 
10 J&£*U ii6 4$^ltI6nTtfc^ir-^tfctt®i5 4 

MPU61 li> mU 5 4^6A7J$tl5Re ad / W r i t e # 

x 57 6 6 ©T^-t7;^ff IIB^ifiE^-ffi 

15 ^> 0 f l/T> ^<7)jIIg^{C^o T> ?4 7.9 6 6 ^^tLfcr^T,^ 
H ^< 7* (^EItk) id, K^-fAISB86 3£^ LT7^t7t5. 

HI 3 , MPU6 1 CiSr-f - U > £f © Ig( 3 £ 

Wim-t Z> 7 u — ^-y— h~C$>Z>o MPU6 Ki, £?\ tiL&^v* 
)V(T> R e a d / W r i t e O'J 7i^Y At^^lCf ot. A* y 7 t 

20 ^tu 6 4©,-)i§i©^fi^D7^CT~^$-^i«-rs(x 

25 f7yS2). S^ii*^— ^©-l^ieSlroi&Kte. S^flSltjfcfe 
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M A tr y Y<Do%. "r — Z - Zf P y t> ' f\ f r y V <D ^ — 5> <D Zh&W 

m b . y - - ;i >r y h tij^^-r So c © 66 , ¥ ^ - • n>x y V 

5 CAN - E DFCS^^TX^ya-'J > £ ff ? (Xt7^S 
3 ) 0 

S i£ i£ 1/ - Mi > y 5 - • y V tz Itr- 9 • :/ o y ? • 

h ^mmmm.L rcm&o v- v \zmm z\<d t. m^:/ 

10 ^^^^^^C^jtU- hTT-^^eiit 

p y z m tc <o <Dmm<D^r-?&mmr$&mm t u, er 

15 d^Tte, SCAN-EDF07J^'JXAI:S'^^T, 3£ T £8 

m.$c-?Z>o X7f7'S 2T?ftfefcHTiK$SCAN 

- E D F (Cigffi-r^ £ ^^CD^S^^{'-&t)1i:TBf P^^J*U^ 

20 J: 0 W.-f>frlzfcZ> o 

Ml 4 « , Z. <D o £z 4 X & X ■tr i? zl — V > tf <D ffl ^ I, T V> 
Z>a ::-eH, 4^©f t?7Kh l, Ch2, Ch3, & J: C 
h4©o^, Chi, Ch2, feck^Ch SOS'OtDft^JKii 
Write mS^ff^n, C h 4 T«R e a dffil^frfenTH*. 

25 a° y y hWtt, m # & * -x — ? * "a tr "f — 9 • ~7 p y 9 • n*r y 
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A dr y h £ * L , K*T v hDtt, ^ 5 — • l~\*r v h$$T, £ 7c , 
/ty7 7^t'J 6 4|^T*«, f ^;H;ftl^n3o o 

y * 6 4 a ^i«J o mx StlT^S. 
5 Write MIC^^TH, - • A T v hD$i< W$»A^r 

y h W <D =r — ^ , A'7 7 7^t'J 6 4 CO 1 O CD # fir Zf U y 9 6 4 
a fc — Rt#»$ *i£ . c\co<h#, #fi^ny^^©T-^^A'77 

7 / 1 'j 6 4 \zmg&n<D{zm:is*imm\z£ v . T-jivmr 

io fix, rm±&mu- h j, rn7MRg1t$gj, &=ktf t^vhntr 

V ht^S- • /I >y h <7) «SU £ 13 ft lc ^ L 7c A < :MJ ^* - 
CD^— ^ /\'777^t l J64^frlT, i 1 5 C^ti9&7 

£7c, HT^PStf^i ITU, fll^tf, m&7a v Z ft<D?-$ 

<d — mwm\z^ vfcmm&mmi<T t> £ < , tomiz^if-fr-o 7cw 

$)A^r v V • n>rv h (D|^c7)-&tf-$f2^ LT J; ^. m 1 

5T(J, l£^cD#£7$3|SHi IgT^ffl ^ 6nT VV-g> 0 £7c, B15CA 
20 -f ^- U 5 s —* tlTtt, *r#)A^-y h £i&3S " l " Trig U, ** =L - • 
A^r h Jil " 0 " X-m L7c A-f ± U is->T >X^ffl t> £>*1T^ 

3 o 

:tl £ (D,*l7l«tf 18 £ A-f ^ U ^-^W:, f^r-^CR e a 
25 SSfiJfflLTRe adffiIO»7»IIE*«ftS$nsttfct. #tJ& 
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iintCckO, TV53Ci5&fan-6 ICMTSt-^.O R 
e a dfflI$S*bfc§^li3#J(:i5^Tt), S TB 5 2 ^ b itjg 
•Iftife.^— ^ £SttI&3«^<h|^JiCD->--^>X-?, LSI 5 2 £;/r 

5tt)i©ny77^ : E , J*^ga±i:ii^tit&<. U7J^'f 

i&SUtt, ^tflfc 0 *BT#H8I (Asynchronous) ^it^pffg7:S 

n «\ ^* 5 - • a *r v v &m A-H--T \zm®/* 5- y y <d & % m & l t 

10 fciii. ii w ^ a" , feiH^— ^ tigEfc-xw x ^ 6 6 izfemz nx ^ 

SWT, SttflX 0 fl9©^-^Tl52l«SE^ff H&d* £ , IEEE1 
3 9 4 <Z> -5 1 CxatS^i^- PX-&&#mmfcM\Z <fc 0 R E A DM 

mzmn-tz z 

14Hilfch7>X^- h • A *r y h3«l 9 2 A 
15 < ^0faf-^^^^Tl5D, /S y t * =E U 6 4 D y 

« , . #9 3 4 0 i@ (£> A° ^ y b 3 IC ffi ^ f -5 5 s — 9 ifi A y 7 7 * =E U 

^ <7) ^ _ a? . yp-y^ . A ^ y h4$4fiELfc|^, 6 8 0® <D 
20 "r — 5> • -zfu y V • n*r y V 4 *»-HS«$n50 CgtSl^fK^ 

0 1 4©7^r^a-'J>^©W'Ctt. ttt 91 £ ffl * fc: f -5 * . A. 
7 7 7 ^ t U 6 40ffi7oy// 6 4 a(7)^»^#5cft/^7-^ h4| 

25 IWIEj&*8tj£$ n^> <D £ LT ^ -5 o ::f, # 1 ~ # 1 0 <E>&£cEP 
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«, 4 ~D(D^M^tr y h lZttfo-fZ> Read /W rite Mm££: 
#1 : C h 4 T 4 A° v h # £> W $J 5 s - *? Xi?66*^K 

*m$n, /t ^ 7 7 ^ ^ u 6 4 \z— m wmz nz> 0 z\<d£%\ mi 

10 #2 : ^^fcTfcHTiKfiiC^oTR e a d^KDHTilS 

a*iftj££n, m&tzLfcn^ -rv^-? "1010101" \z'&^> 
mm^— & j x ? 6 6 & ^m^ta $ n* a 7.7 

'J 6 4l;-iii$ni) = 

# 3 : # 2 © &l 31 <D m IZ. Sf, C.hliCh3t, 40©W«4 

20 t<o~ mwfemmft zmTwmrf&mztiz. z\<Dt^. use 
aLTi&nTfffcfcd. fn^o/t-r t'jf-^tt^i: "11 i 

25 i^lstftft^nsfcft, C h 1 <h C h 3 <0 *tT US 18 tt (SI C (MJ t. 
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ChlOWr i t'effli*»«ftWi:x^^a-'J>^$n5. 

# 4 : #C K , Chi i^U^THK^It^Ch 3©Wr i te| 
5 'I*t'7 a - U > 9 2 tl 5 c 

# 5 : JfcKl, Ch 2T4QCDtiAy-y hWOf-^O-USt 

W<£> M \Z 2 -D <D ? 5 — • A° y v hD^ie.nTf fcfcfe, /W ^" U 

"7 s - ^ tt "1 0 1 1 0 1 " £ fc 0 , & T «8 PS 6 A' >y h # CO ifteig 

io «FHi:S^^Tft'jt$n5. 

ffi « t£ U T , #ft*JKORead /W rite JUli^mT 
8§ |g V>j|g 3. — 'J >^^n^o £G> jg*, #6liCh3, 

#7ttCh4, #8ttChl, # 9 « C h 3 . # 1 0 12 C h 2 £. & 

15 

PgC0*p.^)®K:|£^£ *l£„ Lfcj&<oT\ St©Wr i t elUX 
i 1 40^TH, izMtiL-? a y 9 zmtt<T>n 

£ cd m co k 2 y d y ? ft & mm L , L S I G 2 t(Dm<D&m\z 

1 y D >y ? ft & m m L X o d CD <£ -5 (3 , /t y 7 7 ^ t 'J 6 4 CO 
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mTMmi)mi£-£ntcm.m\z, m^mu - bx-^-^^^y 7 7 

nxi^ i-/n>^»©f-^^f^^ 6 6 \zwz&$inz>m\z, 
2yD7^©f-^^;\ , 7 7 7/ t | j 6 4 \z mm £ n 3 z t iz u 

10 n z> >& w & & & o 

t^i^nd mTmm<D±mu. /t^r^tu 6 4(Dfijfflnj 

15 (8/*$-y>©16aiP*M) fc-SLTiD, 46 it 1/ - h it t tl «fc 0 
/jn $ < & e> & t> *> © <h U /£ L T ^ & o 

<n nTMV&m m<Dffimit 4 - 8 ntr y b x& 

20 0 > I E E E 1 3 9 4 \Z 3$ ft 2> 1 J\ *r y b <D fest B# M tt 1 2 5 ju. s 
Ltctf^X. 4 ~ 8 /\ c ^ y b & IE 2! B# £ tfe » f -5 £ . 5 
00/!S~lrast&0, 3£ 7 #1 « > I^WJ*^ 5 0 0tfs~ 
lmsglLfcl^itas. Hll&Pt^tLTtt, /t 7 7 ^ t 'J 6 

25 ^{c, ii6it mm&mn'r ? b \z? = - • v btf^sn 
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& ^ m <d f 4 x z x x =l - u > v <d m & v x ^ . c: <d m 
cttx^it v- h a* in c T & n «\ ^-n <=> coms©^tmis«r c 

& £ „ £ T , SCAN-EDF07;M'JXAi:So'f ,H7i 
<?> V> M fcH fr'jifi 5£ £tt 3 o 

0 1 6 (DMT-it. Ch4©2 [3 <Z> R e a d#l3I (# 1 33 £ ZS # 2 ) 
i^J&Jot, C h 2 <Z) W r i t eMi (#30 \Z & K> . — Z -ft 
l^l^f ATCh 4 (#4), Ch3 (#5)> Chi (#6) CDjll^ 

10 jHH^nSi^X^ya-iWitt^ns. ^<£>^, #7HCh 
1 , #8(iCh3, #9ttCh4. #1 Oiitfftl lfi'Ch2. 
#1 2ttCh4, #1 3fiCh 3. # 1 4 C h 1 <h & S . 

# £ , il 7A^i2 2tt$#ibS:^^, MPU51ti5 
7yya-iJ>^Mlt^^THitIl^1-5o MPU5 1I1 * 

I5 It^S©^^ tT>;i/CDMl*l^bfc7i^ya-JPr-^Jl/ (^1 
^) S«l$'l/T*0, d O^"— y'JV &m ^Tr X 9 7 0 ir X <D X 

II 7 ft Nf t^i^Stl:2Ni (fft?J^fc0 2i) 

20 11 7OX^ya-Jl'T-yil'7 0C&M|Orde r ( I ) (I 
= 1, 2,..., 2 N) tt\ Read/WriteMS 
<£>^SU1f $gR/W, 5^^^;i/#-^C, ^ock^^^ X ^ 6 6 ±<D7u 
»^7FkXA*^*, HfffS©l^©Re ad/Wr i t e M 

25 tf&mznfcVtm&^LT&o . ^nz<Dmm(Dmmi$mTMm.T 
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£ , Order (1) i:^ttl5§r-^(Di^$ i ii, ttfo 

rder (m-lK Order (m) (;t^tl5§f - ?<Dmx. 
5 ^ j , kt3-^^^Tt)|s|«-eS^)o Wi teW r i t ell^, 

Rj, RkliRe a dll^it. 

1 1 8 (t W r i t e MS© X v-l — U > .«fc Ztmi7<D7 U 

x ^ 3. — ji/r- :/ ;u 7 0 izmmz n~z z>^m O r d e r 
10 c i ) (Drngtz^-r* 

m&&fr7 £ —?&rSy 7 7 ^ t 'J 6 4 £ — NF#»^nfc^<i: 

Wilts (x^y :/s 1 1 ). -b##w^^t Lxi^i^na^f 
-yys 1 1 © *y £ « o jst . 
15 ft*;nET-^iTO7t5i, friz, ^(D-mwmizmv 

fc m ffl Id fi£ o T ^ * * JVk <D W r i t e^I©^71PSTk £ ^ ffi 
tS (Xt^S 1 2). -^f#WB#P b 1«, ft^JUcOgll/- 

^ ^ * JHc (D &m V - Mi > ? a - • /I -Jr h © fij C: o T ^ 

20 fc-r&#\ p y ^ 2 rnfto)?"-? &&m.-t z>r$\ziz±z < ^ 
<D-mwmmmbmcmmT*$> k> , n/t^- ^ £ c out 

mn\zj" 4 7*2 & 6 {c « £ & 46 fcf «fc ^ £ t K: & -5 . -t d T . #J A . 

25 k Plaits. 
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friz. *^I©miOWr i t e & M & ft 7 £8 IS <D V> M lz 
fc"X^ri>3L — jl^'— 7 0 ©ffcTffifc, f tTvJUcOWr i t e 
M^lit^ (Xf'/ys 1 3). t^^^, flm©!^ "1" 
ij > h l/'fcft.' O r d e r. (m) KTk ftlftt 4. £ © 
5 O r d e r (m) RUSK-, Wk , Ck , ts&ZfAb t> 

*(:, : I@$nfc'Ord er (m) £-g-#>T> mi©Ii©^7 

w t & ^ l , v> mi k s m * m^m at ( x t- * y.s 1 4 > , 

□ V 9 <D^— 91finy 7 7 / t 'J 6 4 tC*i»-$nSI5fc, X 3. 

15 ftT Mm.<D%-^ h<Dfr %miz* R#0.r d e r ( 1 K O r d e r 

( 2 ) i»JSfi$tl5. 

Xf'^S 1 1 ~ S 1.40ffllttffl/T.^f y7*S 1 5 ~ X 
f'^S 1 7 ©JH7'I1^, MPU5 lHi0ifT$tl5o 

20 f'^S 1 5). ZWmfeit. 7^rya-^f-7'Jl/7 OCIiO 
rder (I) ^Ii.$tlTU5>^|iJit§®iTS§ 0 
m= 0 f^^tlfi, *»I0Wr i t e jlliO^o tWi 
xyya-Jl^T-7^7 O^fllT, ^©^H^SOrd e 
r ( 1 ) iZ&mZ tlfz. W r i t e M M <0 H ff £ H ^ -f A* HI g§ 6 3JC 

25 m ^ -f ^ (^f7^s 16). k ^ < n m & 6 3 « . 
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Ay y t * =E U 6 4 \zWM$nfzO r d e r (1) KH£#£n7c?V 
ir * ;W i <7>^ — £ » r^^6 6±©7F1/XA i 0 ftg * £ 

5 Sni^SOrde r ( 2 ) <D m M <0 £ 1 o "f "3 m 0 _t 
£ (Xf7/S 17). 1=2, 3,..., mllOHT. 

Order ( I - 1 ) =0 r d e r ( I ) <Z> fi Hff L , ^ 

SmCffl^ "1" T^'J^>hT5. fit, Xr-> 37° S 1 5 JKA PI ' 
©8LS£» O It. 
10 X ^ y -7° S 1 5 tC & V> T m =0T3fenii W r i t effllttt^ 

T»7.btvi5 twwf v\ xt77s i i \z&n-rz> B 

£ 7c , II 9IJ, Read®l07^rya-iJ>^J; D^SIff £ 

4 0tt7'o>^ 2 ffl # © 5 s -- * K ^ -f A |IiS& 6 '3 K «fc 9 5* >f 7> 
15 ^ 6 6 A.^ *K*$n. A y 7 7 ^ t 'J 6 4 l:-f*l$n5 (X 
X" y 7 S 2 1 ) . , J- -V * ;i/ k T 5 m W <D -7* D v $ (D 5 s — ^ A y 
77^t'J 64^bLS I 6 2'\fe3t4'"e&D, ^©7ny^0T 
-^tt*tt**«»7l/ttt5. 

^ CD B# . MPU61IJ, £?\ Uftl^Of t?^T$fi7o^ 

20 ^ ftomfrm l "t — & ifin y 77 * ^ u 6 4^6ioai$nfc^i'. 

«Xr77*S 2 2 CD¥iJ^£jjt 0 It. 

fit. xfy7's2 2t, k (D^— 9 om. o ta v&m 

25 □7^©r-^©^7»ii1ti(:f oT, ^t^^kCR e a dil 
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^{C, HI 8©7fy/S 1 3tHSII:LT, * M a© m ffi © R 

k © R e a dH^Iif^ (Xfy^S 2 4 ) „ fLT, 08© 

AT ( X 5 s - V y S 2 5 K Xf>^S 2 2 ~ S 2 5 © & 31 * |£ 
Oil-To 

M P U 6 Ki > Xf7^S22~S25© ;U — 7° M a <t Mfr L T . 
7f 2 6 ~ S 2 8 0;i/-7'Il$HfftS. 

-r m=o frEo ft*mi£tz> (xf^^s 2 6.). 

m=OtSHn(l S © R e a dil^ioT^Stflil, 

0$#II/T. flc^^HiOrder (1) 
tSS^tlfcR e a d 4fl S © * ff £ K =y << A 0 S§ 6 3 t ft ^ f -5 
(Xfy^S 2 7 ) o fit. K 7 «f A* HI S§ 6 3 11. 6 6 

±©T Hl/XA i (Oti^bft^Jl' i ©^- 3? ^M^-ai L, . Ay 

^ \Z , MPU6 1B. HI 8©7> y^S 1 7iR|«l:LT, X 

0 £ 43 lr> T O r d e r (2) ^ T © 1? ifi © # 
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;^$10f^»0±Hr.(7fy^S 2 8), nit\ Xr7yS26 

unomm&m o &-r. f lt, xfyys 2 6i:^^im=oT 
2 2 \z&n-r z>o 

5 W r i t effiliRe a dll^gftt^i^tt, 02 0 

CitJ;oftj5iI^fft)^S. MPU3 ltt, , ^-fti^cD^ 
t^^T/^^T^/E'J 6 4 ^ <£> X ^ -fe * T b 7c H o ]&> *U 

^ts (xf7^s 3 1 ) 0 7 2 -txwmT UTu^^naxfy 
y s 3 1 0 M-Tc 

10 fit, Xf7^S 3 l l;^^T« ? t ^ k ® A' 7 7 7 / t 'J 

^Oli^Wr i t e®li;f#^-^fI»iRe a d illt:f#^ il 
K> tiil, (D^-ftl-Vft Zfr&mfe? Z> ( X 5^ >y ~f S 3 2 ) 0 T^-feX 
— B##«-rabn«\ 11 8»Xr77'S 1 2 tMiilLT, — B# 
15 ^ISI^P^ e^TSBPSTk £0¥ftT& U.f^S3 3).- — 

Td7-fe^**sioaib"eftnji. 11 9©xf7ys 2 3 t m M ic l 

t5 (Xf^7"S34), #c fc: , EH 1 80Xf77'S 1 3 h m U 
(ILT, X ^ 3. — 7U ^ — 7*^7 OOfiTtiCf t^Jl'kOjQI* 
20 Sgt5 (7;f77*S 3 5) 0 Z.<D£^, Wr i t e M 3 <D 4g 
Wk AJSfi^n. R e a dUlOl^URk **£®<**i"5. 

\Z . 01 8©7f77"S 1 4 tl^ifCLT. 7yya-Jl/f- 
y;U7 OOSISii^iA (7fy7'S3 6), 7f77°S 3 1- 

s 3 6 <D)is-7mm&wi k> £fc, _t is 7U — ytmw t-M.fr it, x 
25 5f y ys 3 7 ~ s 4 i <D)\,-7mm&nft? -r £-r. 
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m= 0 T&ttttfcT, i? =l- )Vt--7 )V 7 0 $#1LT, 

mmo r d e r (i) tc g# $ n tc mm <d mm & ^ x. ? v r <x 

f '^S 38), LT s TWj tf^mZ tlX ^tllt. Wr i t e M 

5 m <d m ft & f ^ f a- m m 6 3 k *t m l (^t^s 3 9)« r r j # 

iSSnt^na, Re ad$a?Itf>llfT£F^'fA*t518&6 3 13^^ 
f 3 (Xf«y^S4 0). 

& . 01 807r^ys 1 7 tiiCUT, X 'Jr v 5 ^ - )U - 
^;i/7 Ot^^TO r d e r (2)£*T<Z>^3SKZ>#-^£ 1 O ^> ** 
10 9 ± (7f*;^S.4 1), Xf y^S 3 7CI5. f LT, Xf 
>^S 3 7i:fe^Tm=0T$n(f, Read /W r i t efflltt 
t^T»7UT^5i|iJ»fl/, Xf7^S3 1 CilTtS. 

£ £ 3 7; > 018«DXf*;/S14, Bl 9©Xf »;^S2 5, 
*5cfcZ>*g]2 O^XT'^S 3 6 tfe^TZ^r^a- JPf- r/JP 7 0 

#j x. «\ mi 7 in *5 ^ t m tc iz mm £ n rz s m & 1 -z> ± <d mol <d 

UXATHMPU6 1 KSfikSftfcO r d e r (m) 

20 (DmTmmTW (m) ^Order (m - 1 ) <£>3&7J«T j (m 
-1) tjt«L» Tk (m) >Tj (m-1) T&tlfcf. M^<#*. 

£7c. Tk (m) =Tj (m-1). T&fttf. ^«E©^u/F<^y 
& y & T F 1/ X A h , Orde r (m) ©^D7^7FUXAk (m). 
25 & £ border (m-1 ) ©7*D-^7^XAj ( m - 1 ) <D 
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RtSfiyi't*. fit, Ak (m) -Ah >Aj (m-1) 
- Ah Tfetlkf, Order (m) (D^jifiO r d e r (m-1) «fc 

5 {Tk (m) = T j (m-1) AOAk (m) -Ah ^Aj (m 

-1) - Ah } , ^fettTk (m) <Tj (m-1) » tl « , O 
rder (m) tOrder (m-1) ^AtltAS. -rlt, m 
"1"t^J^>MT, ^^©il^H?) It. 

©j§£-> mtciz&mis ntzmmomr mm\t&\zmmts nx 

io V> SliCftiJ; 0 -feiiVi d t^^i^pT # 5 ©T, £■©•<£ ? ts.7 )V 

^fc, in i 7 tc^iriTfffcicsft^nfcs**, — 

2 © <k 5 K & 5 . C07J^' l JXATIt M P U 6 1 11 , £ f\ O 
15 rder (m)©i{&T»3l5gTk (m)-£Or-der-(m/2)©*| 

TSHIETj (m/2) LitmT^o 

fit, Tk (m) >Tj (m/2) T&*U£, # H. , Orde 

r (m/2) ^Order (m) © FbI © £ £ Id ¥ 9t © M$L © O 

rder (3m/4)- Stk«M*tt. Tk (m) £Tj (3m/ 
20 4 ) £Jti&-r<5o — Tk (m) <Tj (m/2) T&*U£, # 

fc, Tk (m) $Tj (m/4) tJt«TS. 

^©i^^ttiiii^iDibT, Tk (m) rfm-r z>mm&&* 

KltfcD&AyT^#» *^(cffiS^ L fejIIMfefc O rder (m) £jfA 
-T-5. dtUCfctK 2 ©^#*g£©!El!&T?Jttfc***$T L, 

25 *.a<jt«EW*sisfBjT&7-rs. 
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m 2 3 & z m 2 9 £Tr&mm i>fc& z st©f t >*;u 

5 M&lsfc&olz.mig. "t 4 X ^ 6 6 fC« 1 0£Jl_t(D h 7 y £ *j 

e.^-5«^c©v r ->^^ij- enxv^. z c a vtjjScd*!^ 

t eiioti:(5i;Ty->5^St5ii0ii <z> H 3 £ ia -r 

t-ht^li. MP U 6 1 U , ST, IS^t^JKDR 
ead/Wr i t e © 'J 7^3"f -HO^o^f 
15 tTr-^*Ay77^-t'J 6 4 t-«ff «tS (^f^S 5 
1 ) o ±m b fc «fc -5 K , *&7*D'^0t<Xtt. Sit, 6 4KB 

.. ^C'JT^MAOWr i t e ifc ^ © 21 fr & Ji « k: ti » 
-^©HfrfSKltiE^ T^-r X76 6 ±©"##&*\/ — > £ =fc 0 fl>J5 (C 
20 III (Xf77*S 5 2 ) , W r i t e fft ^ © H fx % M o i§ 

f«/7'S5 3). 

£ <Z> 7? f£ T « . Wr i t e fit ft <D&ft&£.V—> 
ttfcttft £ tit* 0 , pmicHfTT £ W r i t efflKOSlCftJDT 
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MZ-tts MPU61S, X t- V -7 S 5 2 \Z *5 V> T . » * & * 7 
K UX £$gfr» <fc «9 ^«©\/- >lC^«lb, 7,7- v 7 

S 5 3tli^Ttt, «*a*T-H UX**ff »»'*f**r*». i: D 1*0 
Moy-X:!!!^ Wr i t e Bill 

wr i t e mmnmrn v- v \zm cxv- > zmmnm 2 

OMS^rl^BJ-r^^a-^^-h-efe^. MPU6 1H, ST. *g 
10 gi^ * *)U<DR e a-d/W r i t e C'J 7J^< A^t^Cf — 
Sro^n-^Mtf-^^A'-^T^tU 6 4 — P£ * « -T -§ 

( X 7- y y S 6 1 ) . 
*CJJ7;^-fACWr i t efb<fr<D^ft%C&m?Lfrm&lZte. 

n £> © © utT v — v <d m- k: o t 4 x * 3 6 _k © « # & 

15 ^-y— >^cfc0^MIC^3EL ( X 7 y X" S 6 2), Wri t e^^- 
oTttji*y->-* ( kOftl3i:3£It5 (Xr^S 6 3). 

MPU61I1, X 7 y X" S 6 2 \Z *5 T « , m 7L fcf . *g ft © W r 
i t e tft.^a*^-r-5 3tej2t P- h <Df®%\tfWl&<D'\ v 
T^y-XDStpfeill/ - h£_tigs&SfcE, »£&^7 K U'X £ 
i^i© 1 /- / t ^ m T % o 
25 rfc, 7fy^S6 3i:*ntii, *ESi h a* 
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^ncfcO^^cy-^CfitS. d <Z> <k 3 t~ , *g|fc<Z>Wr i t e 

5 H^it^utl?, r^f 6 6 $ J».*.W t:tiLT< -x^X^6 

13 2 5 te, t^H6 ±0*»'0 7- > — >©feiH 

h®W$iUTU§ 0 r^^3 611 60(D7->Z 1~Z6C 
#fij£*-l> '/->Zlv Z 2 , Z3, Z4, Z5, Z 6 ©sg4te, 
10 -e.n-^n. 1 h7^. ^/c D9 2KB (+D/Hh), 1.00KB. 
108KB, 116KB, 124KB, 132KBT^5. 

T'f 7^ 6 6©0felC§ 1 0 0 0 0 r pm (6ms/0g) £ T 
3 £ V— y Z 1 . . Z 2 , Z 3 , Z 4 , Z 5 , Z6 ©<gaH U— h H. 
fn^n. 15. 4MB/ s > 16. 8MB/S, 18. 1MB/ 
15 s , 1 9 . 5 MB / s , 20. 9MB/ s ; 2 2.- 3 MB/s ift 

112 6te, 12 3©7->fttIII'f oT, 0 2 5 0<k37i7 
— >^5 i — ^**#atrffiS©^*^bTViS. S^T, Wr i t e 

20 mw<D?- y *ju&ifi i cchi) mftmw— > z i a* 

llRSli, b 7 y ^©^f6l (R^^[SJ) CioTChl. Chi, 

Chi, Chi <om\Z. V— >Z l©a^7 Kl/7Cr- $ 

*iffE$n5. Sfc, ^*;H&a*2 (Chi, Ch2) 

« , > ;->Z2^1f}^n, Chi, Ch2, Chi, Ch2 

25 (DMiz, 7->Z 2©I17Kl/Xl:T-^^'f f ii^ns. 
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■^■V*;Hfc**3 (Chl~Ch3) 7->Z3^1S? 
$ n ; Chi, C h 2 , ■ C h 3 CD IH , , /->Z3©ii7 

H v x \z 7 s - * £ & * ti 3 o * & , ^ * a* '4 ( c h i ~ 

Ch4). Ci^tt, > /->Z4#I«Stl > Chi, Ch2, Ch 
5 3, Ch4,... <DMiZ. >;->Z4Cl^7Fl/7ll7-^^l 

it&snso ^**;Hfcj&<5 (Chi~ch5) co*-&«, y-> 

Z5^I«$n, Chl> Ch2, Ch3, Ch4, Ch5 

<DMlZ, V- > Z 5 CD mm T H 1/ 7s \Z =r— 9 &m * & * n -5 . 
^•V *;i/$C/&* 6 (Chl~Ch6) 7->Z 6^IR$ 

10 *U Chi, Ch2, Ch3, Ch4, Ch'5, Ch6>.. . CD JIR 

y- > Z 6 CDgglT H ux \zy £ -?rfm%&s.nz>o 

&y- >&\zmmmm u- b^mm^n. w r i t e «t.a©tesiV' 

- hco|g?n£;icoX2pfciil/- h <hJt«eLT> »#&*y->a*fc 
15 -3£ $ tl S . & W r i t e ^EL H CO ^ it 1/ - h « . A'«y77^ 

=e u 6 4 k & # s y o y ^ o (D-mwmmm fr stursn 

If fell/- 5 \Ztf L fc&V— XD&mU- h 

20 fiLt, g-y— >cofeii h co 3 o %mm<om^m z. t. \z 

L , y — >Z 1, Z2, Z3, Z4, Z5, Z 6 CO * 2p fe M 1/ — h 
^n^-'n, 5. OMB/s, 5. 5MB/S, 6. OMB/s, 
6. 5MB/ s , 7. OMB/s, 7. 5MB/sit5, 
ST, W r i t e M W CO feiM U - h CO 5. OMB/sKT 

25 CDJ§-&te, «rtS©7->Z l*Jl«Sn. 12 6 il^ill Li, 
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y- > z 2 <oii7 k \z? £ -?i!)sm%&$inz 0 

fcvk V— h <D%k%\& 5 . 5MB/siD : *t<6.' O-MB./sK 

n**6. OMB/sJ;D^t< 6. 5MB / s KTCinft — 

<7)^ft^6. 5MB/siO*f <7. OMB/sKTC*^li. 
'/->Z 5©iS7h*l/Xl:r-^^*fiASn > f.n^7. OM 
B/smS<7. 5MB/siXTOl^lt 7->Z6 0ll 

7HUXl;T-^^ft^tn5, 

rc tc fie o t t # * i5i o -> - > -> ^ )v \z m # a * n -5 .. cnc 
<fco> f^x^ 6 6«y-^t ^, m^^F ^ © m m £ M.MT Z> Z. 

12 7(1 12 3©>/->^^MIt;S^<Wr i t ell(D7 
o-ft-htftS. X h U- i?'f/H 7 5 1 H, 3= -T , Nft^ 
;K^(WlBtWr i t e^^^SttftttTf tl^S^fTb (Xfy^S 
7 1), PINfW r i t e&g©^r*;P j&«&Sj&><!: 5 

fx-^TS (Xf y^S 7 2). 
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f- -Y * )V ft-N £ 1 tt ft '-4 y 9 U X > h L T (7t^S73), N 
9^ *-;K3-HP#W rite jffll^^^ya- U > ^ £ n 7c T H 
fr T 5 ( X r" y 7 S 7 4 ) .■ :©if, §ft ^;HDT-^tt, M 
1R ts'tift > lz is — tr > >> * )V \z m # & £ ti . 7r-yyS7 

- > £ 1*3 fl! C L , * * )Vm. N & 1 fc ft "r V U X > h L T (X 
f^S75), N = 0 i75:o&^'t*^j!)^?xy^-r5 ( X y 

"j s 7 6 ) o n = o -t? & w- n , 7,=rv^s 7 4 ys&cvmm&n 5 o 

f LT, Zry^S"7 6CfitiTN=0 tfttitf, Hgp#W r i t e 

15 sf^^6 6fit pgra v- > icm* ITf- ^ d £ 

->©f 18. 8MB/sT££o 

20 1 2 8 (J, :0<t^Wr i t eili07D-f f-fT$5. 
X h l/-yrAM X 5 1 its *«§£^ ^J^W r i t e CD U 

t'J 6 4 C-^ff «T§ (^T">yyS8 1)o 

K^-r A'lggs 6 3 »/- >mcdm-^cd y- >t» lt, 

25 *t|&^-v^;K£>Wr i t e €fi^\Zltilfc^ %%ft%L\ft<D-f u y 2 ^ — 
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X:^^ (v-^-r^)) (Xt-^S 8 3). 

^ii^roy-xcwut, It?t^;i/©Wr i t e 

5 y S 8 4 ) . •- > ft (D HtlJj <D — > ItZ s\ y I s & MT (7f^S 
85), 

8 6), T-^^'^7bT^^^n«/ Xfy^S 8 2 £1&(DMW 

io ^La&^yr^. 

c © ^ s j; n « . y - > *f £ & & ft n £ ^ m<D y - > p B i £ ^ y 

H ^xSlill V ft & % , §y->l;y-y>vt;Kc 5 s — *? Ifim 
15 &£*i£o cititCctD, ^ x 5 ±i$-x&m u — h 7^£Hfc£ n<5 

i 2 9 ii, 12 8©f fE^il0^J$^lT^5. Wr i te 

M£>9^*;n&£3 (chi~ch3) mftm<DV->z 

20 *5^T, Chi, Ch2, Ch3,... OlCii7 F I'XCf- 
^ » ^ & £ n , # Id , !/->Z6K->-^l/T. Chi, C h 2 > 

ch3 — (DMizmmy k u-x c^- ^cd 

^ ^\ y h ii V- > Z l <fc V- > Z 6 © ffi £ a ^ L ft ifi e> . 3f 
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1 2©MPU6 lCctOfrfetlS. MP U6 lit 13 0 
•5 (I , T ^ P ynt7+^7 1 ch^^E'J 7 2 £ tf o /^U 7 2 « , 
^JA^, R O M ( read on 1 y memory) , R A M ( random access memory) 
5 m^^Zh* WM\zm^ etl^^ny^Aif- DISH'S, T< 
^□yDty1f7 1 « > /tU 7 2^fiJfflbT^n^^A^^tT-r 

a* 7 5 \zmm^ntz.mwmmmw 7 3 pjmibm# 7 4 ^ 

^iljb/^-cDfS^rt^^T^-trX-r^o pJ M §5 ^ 7 4iLTlt 
10 ^t'J*-F, 7Pylf-f Xf, CD-ROM (Compact Disk 
Read Only Memory )> << 7. f . yfffi.m.'r 4 (Magneto-Optical 

disk) &m<Dn > tf a.-?m^m v ^mta^mm^^m v>en 

So d CD pJSSfB^^#: 7 4 t±ai©7'D^7Aif-^ ^ftfflLT 
& # . ^SCffrCT, ftl6^MPU6 KO/^U 7 2IID-FL 
15 TttffltSCtfeTtS.. 

£ £ Id > MPU6 lit LSI 6 2^HT, ^gBcD^yh? — 

^%h^«, * — a*-/ h v — ? \z & w & $t m / ^ ^ — ? <d mm 

£zi >t:^-^^X7"A-\^D^tf^-&tCfe, m <D M W Hfi m T* 
25 £ 
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LfcmsjgjB©aB«*^:*si^-rsBi"r'*s. *&wfe. as 

HI 3 li^H3 3Ttt, g 3 «>{;:;. Ii3V*->L 

Zl, L Z 2, LZ 3O3O©iay->Cf-^SIStt50i|$ 

H 3 1 (C tfT «fc O \Z , #»1 , ( /->LZ1, LZ2, LZ3(J, 
15 U7>Hl0 2S-f L, ^fi5-fe 7 ^ (if 

•T-57^i6^,^;P-7 0 l 0 1 t7>h*l 0 2 (D^rtl^tliZ'&mi'T * 
5CW1z??l 0 4. 1 0 5 ^f(t^tlT^. 

EI32«, lft>^JK5f-^^ll , /-/LZ 1, L Z 2 , 

l z 3 \z.i/—>r >zs* )i>\zmm?2>xt£&mmTz>m-c&Zo 

20 |SJ@ (a) tt» ^S > /->#fe-efE^-r^0iI"Tra5 0 , -Ifcg*/— > 
LZ1, LZ 2, L Z 3 (?) JH fC . 1~ 6 (Omfr-V^—? fflvnaz 

n-5o -r^^-fe, ci CD ^ > &mmv— >\z&\,*x\ ^-^10 

1 . 7> F 1 0 2 © JH \Z — 9 ifi IB m $ n -5 o 

mm (b) ' «u tf)is—-7ioi<D&\z&m-$-2>wv&-*)* mmv 

25 ->LZ1.LZ2,LZ3 0)MIZ. ftlftllD^f-y 1 0 1 IZ \ 
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"r— * tfrnizmmztiz * mm (c) it. ? > k i o 2 <D&izmm 

■TZ>M-(:& 0 , mm*/— >LZ1, LZ2, LZ3 (DjlHH, -^tl-^ 

n©7>F 1 0 2 ic, 7 s — ^ a* wm £ fB m £ n 3 o 

HI 3 3 « , 2ft>*^<Or-^S»l , /->LZ 1. L Z 2 , 

5 l z 3 K^Pf ae0T£#&£i&WT5igT&5. 

1^ 0 & ^ T , 1- 1—1- 3 ttf t/^iKh 107- ^ , 
2 - 1~2 - 3 ttft>^Jl'Ch2©T-3 ? ^^lTl^. 

11 , /->L ZL LZ2, LZ 30 M \Z . Iffr—Zf 1 0 1 
£ -7 > H 1 0 2 fc 3£ 5 (C -x— ^ ifi IB fii $ n -5 f t/^iKh 1 
10 ©7-^tt»I , /->LZl, L Z 2 , LZ30^JP-yiOl!: 

laesn* ft>^iKh207-^am7->Lz 1 , lz 2, 

LZ 3©7>H1 0 2fcESSn5. d <Z> «fc 5 > ?t>^iKh 
1 <D"r—9 ift>T^l/Ch2 ©7-^ 101i7> 
HI 0 2 {d#ttTiB^T -5 n £ T?. — ^0^ J r>^;KDfH^7— ^ 

ir >.*)V<D ; rr-9 L T ffi 31 {3 IB & T * £ £ ri* T it 5 . 

03 4 , f t/^iKh 1, Ch 2©2^t>^;^f^iBi^> 
13 3 3 (a) C^-T^^Tff -3 fc'&\Z, >*)IC h 2 O.BBflfcHU 

20 B££fr^, ^©i^t >^;PC h 1 ©!Hir-^©**-^-yn U 

( a )" tC^-f <fc "3 II , /->LZ 1, L Z 2 , L 
Z 3 <Dtf)l—-7 10 1C5 1 f>l;Khl ©7-^^, iI'/-> 
LZ1, L Z 2 , LZ 307>R 0 2ICf t>^JKh207- 
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&\z\ mm ( b ) (c^-Tct o (c, mmv— > l z i , lz2« l 

Z3C7>lf 1.0 2*5 ^-"V > ^ ;U C h 2 CD 5 s — ^ & gij L <h T 
f t>^>Ch l®f-^tt»i , /->LZl, L 
Z2, LZ-3©^JI/-^1 0 lClftLTSS'SnT^SOT, ^ 

I7->LZ. 1 , L Z 2 , LZ3©7>F102I;, $T7clC, ^ ^ 
>*)IC h 2 ' co^- ^ £ <fc 5 (Cf £ £ £ h aim £teZ>, 

£7c, ±i£<D £ -5 £ Lift >*)IC h 2 CD5^-^ £fij|&l,7c*£ 

fc, ii'/->LZ3£(li;, ff^fc, 2^^>^;p^|FiP$fB^^ 
io ^ff L7tv^-&(c«, (c) \ztkT £ o i:Lt > 5 1 t>^JK 

mv— >lzi©7>Fi 02 £SfeJi\/ — > L Z 2 <D^;i/-y 1 0 
1 ^IB^^nfc^^ >*^C h 1 (Dy £ -?&&m2 tl. is>/-> 
L Z 2<D#)V—7 10 1 Kf&3I\/->L Z3 0f t/^^Ch 1© 

15 T'-^^^ib^n^. iwid ( c ) \z7jk-t & o iz. mmv 

- > L Z 3 cD^Jl/-^° 1 0 1 t 7 > H 1 0 2 tfgnz&^M®. 

Z<D Z\ £lz£ V . mm (e) iC/Tti^f:, II , /->LZ3K^ 

cd^;u-^i o l t 7 > H l 0 2 1;, ^n^n. ft>^;Kh.3, 

c h 4 (d^-$ zmmmm-t z> z t^pjm\zti^ 0 
20 n 3 3 Rztm 3 4 <om^ &nw.T ^^mmmm^mm^m^ . ei 

3 5 (D ^7 □ — -v — F ^tlL/cC^bi^t^. 

f2^> £ fciZWimtit^&X 9 y 5 (-7vis=L-7y 

y - k^^t ^ (xt77*s 9 i ) 8 

& £ , X ^ «/ ^ \z ft » 3 * W ^ L (7fy^S 9 2). ifr 

25 ^73: ^ruMs £^Tf£ 0 
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X ? v >7 e> $t<fr £ 0 ffl V , ^©^^^1 c h & S H 2 c h <D 

^ y S 9 3 ) , 

5 ^-l-t, i c h (Dmm^^-v frtnt. mmv—>, ^)i—y\ £ 

7'S 9 4, S9 50jfliOft. 7f7^S 9 2 1:^5. 
10 7f y^S 9'3T*^*n ch»5Htt2ch©^fn© 

tft <fr T & tl tf , 1 c h©S4^ff^ (Xf-;^S 9 7), Xf7^ 
S 9 2 CIS. 

15 xf y y s 9 6 -emmfr^tmfe vrzm&iziz. -e 

S9 8) 0 -r & t> , 2 c hmmtzmvrz m& ©fr*©ft>^;p 

©giJ|^-C&S^*iJ5£-r S (H3 3#Rg). 

f H, 2 c h IB^OM-^OgiJI^T^^; < , 1 c h f E ^ <D gij IS& (D 
20 ifo<frT*ntf. fg5££ tlfe 1 c- h SE » £ KM Rfc L (Xf>^S 9 9 ), 
Xf7^S 9 2CI5 0 "T fc> . 03 2CSt«fc5* 1 c h£i 

25 * ;kz> em Bfcft ^ t & n & . f ©fr^of t > ^ ;kd is @i £ n 3 V — 
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z> (^f^sioi), fix, £ m « + # ^ & tu* , xf 

5 yy°S 9 2HS^^, bT^ntt*, )k<D 2 c h fWf 

\z m x . x v ~7 s i o ox ffl $ n ^ o 7t ^ ^ > ^ ;kd is 
xf i o o xtfji-^Sifcte? > H \z&gtf$i cfc.m 
m v — > # — ^ — n u ^ -> a >-r s (xf^ys 1 02). 

d (7) # - ^ - i? ^ V 5 -> 3 > « , 13 3 ( b ) , ( c ) IZ^kir^m 
10 cfc D fT -5 o ;ni:J; 0 , .^titt/i^iiy- > #~ *£ j!ra T S 0 

x 5=- v y° s 1 0 2 <D mm (Dm. xf-^s 9 2 

Pi±©J;5tlbT, 2 c h <Z> H fl# 15 iHC :fc 1>T, 
v > F<Z)S^&£ O £ < fijffl LTf5@lTS Z\ tT, f&T, 1 c h <D 

siff mi& g'j^-r £ d £ &X % Z> „ 

20 \ZtkT £o IZ, rtit^J^CfejllS^S^SZ CAVlCiOr-f 

xm io (DisiteM^^^T^ k 7-1 ~?xu. femmmeim^Pimiz 
vxmm-rz z\ titmmtfcz . -^-"^ fom<DV-> tnm 

^itigg^^EHt £ n> ^^x^ 1 1 o^^-e-^iz-h/oMt^n 

25 <5 o 
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13 6 « . _t m b El 2 5©t^X^6 6 tl^I^I^T\ 5 s 
X ^ 1 1 0 & 6 O © >>— > 1 ~ 6 £ #t!l L & D , V 

-htlT, 1 8. 8MB/s^H6n5, 

m 3 7 ia 3 6 tz^-r yftmm&LO'r ^ x 2 1 1 0 \z\ 2 
5 c h (Dmmmm.^mm LfcM&vmwzmmrzm-v&z. £-r, 
mm ( a ) c^tcfc -5 (c v- >u y- > e £*nc lt, > 6 , 

lfc, f tifn, V Y >*)VC h 1 , 2 05^-^ £I^BtfE0L7*: <h 
t5. :o*^..h7^ ( R ) ^ [6] \Z & 9- V > * ;P © 5^— ^ £ 
ia»-TS. A'vFCy-i'll \/— > 6 £ \/— > 1 \ZM 

10 L 35 5 id ff to ft -5 . 

#k:> urn ( a) «fc -5 y- > 1 & e> c h 2 coie® £gu 

Ch2' <D?-& l/TfE&-r<5 £ i^Bltgfc^S. sit,, 1*1 

m<D^^mwi.<D^.iAmuQ lt, 2 c h.©rai#a2&&-rs*!B'ra<^& 

15 < &tjT"^ffc*^fctt, v RIB (b) fc.^-T «fc "5 v feat . 

' — > 6 <d m %h m m £ m tz. \z , v - > 6 tc sb a $ n t s c 

h 1 £ C h 2 ©f - * tf> B'J tC «fc 0 ^#*t-e#fe >/- > 1 

^ Sb T 3 # - ^ - V n V V is 3 > £ H ffi f £ . 
t l/T, V- > 6 ,tC^€r.<S«&fll« Lfc±T, 1^0 (c) K^T 
20 J: aid. V*— > 6 <t > 2 £*TK: LT> v /— >6, 2C 
ft, f t>^JKh3, 4 ©I^Bf 3Hfi.£fT5 . 

03 8 U . B3 7»C^T&3&^^-f5X;i/:*UXA£IftiB"r-5 

Kg*, y ^ c/u/^i-T^ 

25 -f • 7.9 y*?) \z te&l t & (Xf^S 1 1 Do 
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— ^r, Xfyys 11 2 7?, *4##3Ef.* i¥U^L7t«^lctt, 
X ^ y ? £> tft ^ £ 51 0 £B 1/ , <Z> tfr 1 c h $> -5 H « 2 c h © 

f '^S 113), 

5£$nfc^^>^;i/©T J -^«r|5 »/T 5.(Xf^Sl 14). £ 

fc, 2 c h©fBi^^t*n«, -^©5 l t>^;i'Srt»ioy-> 

t.5 (Xfy/Sl 1 5 ) o Xf y^S 1 14, S 1 1 5 © #l g <£> 

Xf";ysi93 t^^^ 1 c h 2 c h ©^"Tti 

©fB^^^-efe^^i^J^^^S^ttt, I? £ fft £ W: 

^^^O^iTtlT?^ S^|IJ^t5 (X^y"7°S 1 1 6). fit, 
l?£ffr3rT»& tlfcf, 1 c h©^4&frVi (Xf 1 9 7), X 

fy^S 11 2CI§„ 

— ft, Xf-y^S 1 1 6 X'mm&it&mfeLfrM'&lzte. friz. 
■Zrtofflffctiifftfl 2 c h IBS©M-^©B"J|SftT» 5*|iJSt5 (Xfy 

y s i i 8 ) o -r & fc> -5 , 2 c hmmmmLr^m^(Difft(D^^> 

* )V<D m H£ 7r & 5 *U T 5 (037 ( a ) # HI ) . 

f LT- 2 c h BB&©Jt;£©8iJI&T ttfc < , 1 c h S3 it <D M m <D 
&iTT~&ni£. mfeZtlfc l c hgBS-£8»J|lfcl, (Xf-/^S 11 9 ), 

Xfyys i i 2i:i§. 

— ft. y ^ S 1 2 8 T 2 c h m ffigfc L> Tc M ti (O Yfft <D 3=- \ 
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> * )v<d m ffifit i? -*? & n it <o m-^ cd ^ > * ;b <z> ib m & w\ m-r 

5 (Xfy/S 1 2 0), £ rt^$fc«^^coy->(c^ 
5 y°S 1 2 1)= eit, rt«>jT?i^n«\ X^ryy'S 1 1 2CI 

-&^\ i*j^$iT&n«\ ^© 2 c h mmmmizmx. xf^ys 1 

0 o ^ mm $ nfcfr ^ tc ft m m <d 9 ~ > izmrn z nx ^ & ^ - ? & 
p\ m m <d v~ - > iz&m-t % % - ^ - i? n ^ a >&mffi-? % 

r- v ~7 S 1 2 2 ) o 

10 uO^-^-yn l/^v-a i 3 7 (b) K ^ f 7j & k: cfc D 

ys 1 2 2CQ#LSO^, X5^^7°S 1 1 2ICI5. 

j$^^^#j<7) y— y t. &n\z l Tfijffl-r £ c t \z& o , 2 

S39RtfH40tt. El 3 8 ODi^^ffl^ D-ft - ht$5. BJ 3 
9 S. H 4 0i0 7D-^ J f-hOiJgB^^5 , c3i^T, :£ 7 P — ^ * — 

h x-mm-r zwm^r- yjuz-o^xmrnTz. 

20 ft>*Jl'ft«)X h U-Af-^Oif ^^tS t r e a.mtt^ 

HI 4 1 tt. £<Z> S t r e am^flf§r-7^ 

1 2 0Oij$«SStHT*5. 

:©r-7'JH 2011, mflI<7)Stream (1) ~ (m) 6 
ilSStlS.' S t r e am (i) i ft >^^©7 h 'J-Ar- 
25 5 <DmmT~$> Z> ( i = 1 , 2 , . . . m). ^-Stream ( i ) 
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*t|g^$ tlX %>%m? H l/X (Add) £ SIM 7 H V 7s \Z 
SB® $ tit U £ 5r~ * (Data) i©i (Ad d , Data) 

S^K^X h U -AO^TSr^-ri*^ (E.ND)' *i#HD'Sn5. 
5 , S t r e a m ( i ) it , 2 c h|Bi©^f t^oT^S^S^ 
T s t r e amVt^5«a$fT5. 1 c h BB 

s t r e am(5ltt "0" llt^^n§, 

f-^;H3O©iljg{f!l$it0TS5. d©^-ett, f-fXM 

io i o <D\*im L9vm&$i-\z nm<D v—>\zftm ftmonmov- 
> ( y — > i ~ y— > n + i ) tnmonmw— > (*/ — >n + 

2 ~^-> 2 n) BURSTS. j ( j = 1 ~ 2 n) 

it ; ^©tT?0$t(g*SStfi?8 (Empty C j ] ) <h IB §i 2 
tl fc &'^-T fit SI (F u l l ( j )) £*#O 0 Empty C j D 

15 i: F u 1 1 C j ) <D ^ f n CD fffft.fc. Stream ( i ) 

i^'J7 htlfiE^n^, ^. Empty [j J OTK^Add 
te*fj£y-> j (D&gmmoftMT h* l/X £ L > F u 1 1 C j ] 
©7 H 1/XA d d te*fJftl/--> j 010 7 K UX&^kTo £fz, E 
mp ty0f-^ili$f§it^O, Ful 1 (D f — ? ft ittzm 

20 f-^I^^t. Empty CjJ <D#J#Hfite <D 

%m~7 > j CO^-^M) -»EndT$0-, Fu 1 1 Tkj 

©SUDIttttEnd (IB^-^a&t L) 

114 3 , 13 6 13 5kT7^X^ i i 0«D*/— >#|j5fc£«g-r<5 
f-^H4 0SifBT?*5. :®f-^H40tt, 14 2 (I 
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/HJyi'j. r'h^y^ftj; r-t^'^ftj, xtf rt^^7Fi-xj 
y— > i ~ 6 k« i o o oiob77^ e>nx^ s „ sfc," 

5 ltft^tt5 1 2B h) y - > 1 Id tt , 184k (1 

8 4 0 0 0 ) <D± {7 ? tfWLrt <=> nT 04 3 C^^nT^?. 

=k?fc, ^ ^fttt^H.©!/ - <& 0 . 1 /->6Ttt2 6 4 

k (2 6 40 0 0) <D±9 fHfi&l-f e>tlTl<*2>, t^^7HI/Xtt, 

io 4 3 II(±, § y->©'^Ht ^ ^ 7 H i/X i l^i: ^ ^ 7 H 1/X ^ 
^$tlTi3 0 , y-> 1 05fe®ir^;>T K I/Xfi "1 »/— >6 
CDa^ir^ ^ 7 ^7 11 "1 3 4 4 0 0 0" t&oTV\§. 
£*T, BI3 9fttfH4 0O7n-^t-ho«iI?|g$ 1 I8^T 

So 

15 M.. itlf>07O-f t-hT^$nt^5 7 h'l/Xtt, -fe^^ 
■7 K U X T & <5 . 

^T, t^MIO ©$f '/-y^fltSfcfeflf-^^ 1 2 
0, 13 0t«l)llftt5.(Xfyysi3 1). £ CD #3 & S T 

a, ^t<7) (i) ~ (3) (Dmm&ftoo 

20 (1) f-7*;i/ 1 2 ocloiifb 

2c£:, *tf-^*g|bT^&^(!)-C, Stream 
(1) ~ (m) td TENDJ £ £ fit -L . *§ ¥ s t r e a m £ "0" 
izWMfcTZ (MWit. lchiei^^tttS). 
( 2 ) 13 0 

25 ft^V— > (#^-l~n) <h^J§V— > (##n+l~2 
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n ) & j£ & U , :n62ni©';->©Emp t yfliFu 1 1 

X. m9 - > (D - d? mm L> MW:\ZE n d Sr#JPTS.. F u 
1 1 fCfct, E n dfc*W-£-&e*r*. 
5 (3) 5 ESI T l'i < ilfl © rtfi - > © - § 

*t/^7-^-^ inner-zone ;§ "1" IC . m^SIBSLTlKft 
SJ©^^ V— ><DV— >#^£^-f/^* — 37 outer-zone £ "2 
n" tc^^T^o St re am#^£ "1" \ZWi7£T 3 . 

^^OlI^, 1 c htSZ&fccofr. 2 c hSBSl^O^, 
io tl6PJl^ft©ii^J»l/ (Xr^S132), 1 . c h IB m^C lb ft fcf 
Xf-^S 1 3 3 IZ, 2 c h IE fit Tf 35 ft it 7. T v ~7 S 1 4 0 fC, -t 

oitJ&n^xf^^s i 4 7i;itf. 

Xfyysi3 3TB, 1 c hIBfi&OT. ftm \Z%ZmT 2> Z\ £ 
**fttv P^JilffiCDS t r e a m # # $ tl^f Itm 2 Cm© 

15 fit £ftA L , S t r e a m#*fm©te£ " 1 " -f > ? U X > h "T -5 . 
£ . fg # s t r e amttSfc#ftl/&H©T, *@^s t ream 
« " 0 " Z> . d©«lIlc«fD. m2©fittft«Jtt. "1" 

£: & £ „ 

f-^JH 3 0l:^^T. I*) $J <Z> V — > (inner-zone) 
20 §*/->OSffi«§^fEmp t y U X h^tiL, ^— ? 

i^Oj: OTct^Emp t y C I 3 ( I = inner-zone— 2 n + 1 ) 
WM, ~D ft fcf ( X -r- y -? S 1 3 4 ) , Empty CI] 0'J7 

hft^K^V^ »/ — > I IZ 1 c h SB » £ fr "5 (Xf 1 3 5), 

Xfy^S 1 3 5T'©iei©^4'T> Rgl$ , Empty C I ) 
25 'J^h^ntt^iTOitCIBibfc^liJib (Xf^Sl 3 
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6 K ±T (Dm^izmmttlU, f-^JH20©S t r e a m (m 
2) (CEmp t y (I) ©U X h SiliD-TS. Z. tl iZ <£ 9 , Str 
e a m (m 2 ) i:S t r e a m#^r m 2 CO X h U — Ay^ — $> CO V — 

> i ±<D$^mmm^^m^n^ B "A\Zs Empty (n .ouxh 

7$s, Empty C 1 3 tC^^£n& 0 3; > F u 1 1 C I J \Zit, 
M $k V - > I co m m. \z f - 9 ifi IE ti 2 n £ <h £ m T & (c. 

I ©JfeiJ V- > I CO^- ^ *) -*EndC0'JX 

10 fel^^BU^t (7f*;^S13 7), 

# lC> 1 c h CO IH li *t 7 L fij Wi b (7f7 7'S 1 3 8 K 

mm^mrvx^nu, x^y 1 3 9 \zm&&. str 

e a m#^-m 2 COX h U - A 5 s — ^ CO^fEifc £3£T U T ^ ft tlfcf , 
X f 7 ^ S 1 3 5 1:15. 
15 d CO <£ 5 IC L T , 1 c hESO«^l:lJ, S t r e a m#^m 2 

5 ~ s i 3 7 (DMm&mv ml . f^j^co '/ — e> 1 »/— 

H 0 COX h U - At 1- ^ SIBtUT^ < . 

ei/T, Xfy^S 1 3 8TS t r e ara#§ra2(OX h 'J- A 
20 ^-^(D^TCOiB^^^T Lfc <£ HJittlH ^(DtEm^- ? (DM 
K 1/7 £T<7> U X h S t ream (m 2 ) fciiJDTS. ^ 
lc » Empty (I) tc fcfc , + 1, ^Oco^-^S) 

-»Endffl>J7h«Ifil/. Ful 1 CI] \Z it , (y->IC05fe 

25 f IT, >£(Dftffl "J— ><Dm%&&&&&mT inner-zone (C I <5r 
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m. L , Xfy^S 1 3 2CI5. 

ft . Xf^^S 1 3 9 t i5 ^ T , 7 t 7 7° S 1 3 6 t Ye s <h *J 

Bfr $ n 7- ^ , xf7^s i 3 8TYe s t WWr 2 tltz m & lZ \t , 

inner-zone iz I £ K-'jfcT £ S © * **fr n S . ^©ii^-, X t- 
5 y^Sl 3 6TY.e s.tfflf SnfcNfjST, S t r e a m#-^m 2 
07 h 'J — A^—£fB»te£T*IT l/T* t) , nU. 7°S 1 

.£4 ± © =fc 5 tc L T , SB ® £ tl S t r e a m # m 2 © X h U — 

Af-^©7 KUXf itr-^t&f-7;H 2 0 © S t r e a 

10 m (m2) CliL, 7-7JH 3 OOEmp t y Q £: F u 1 1 
CD O'JXh £H#T-T 
— 7a, Xf V "J S 1 4 0 Tffci, 2 c hlBft&Ot, rtJ3V — 

^^^-X^tlTtBSt^. C©7c«£>, ftmmpS t r e am 

Sf ml ^mC, famm © S t r e a m#*f m 2 £ (m + 1 ) t~ Ix 

15 jets, c <DnmBm<Dm&. ftm^j—yizmmsnz)?-* >*)v 

■x — ^ © S t r e a m#^te, ftJS — > iZ^mZ tl%> * > * 
^©Stream J: t) t> 1 O/hS < S5. ^ H T . 2 c h!Si 
T & 3 7c £> , Stream#^m£"2"--f>^ , J*>h-r-5. * 
7c, 2 c hWEiWl^llli, — ? n&faffiV— > £ft 

20 « V/ —>£'*> , ffi^s t r e aralt5^l;j?$Et5©T < S t r e 
am (ml) © *B ¥ s tream(Cm2$r, Stream (m2) 
©H?s t r e amllral C 12 ^ T £ o & fc , Stre. am##m 

2 ©X h U - At-^ ttrt^ V— > £|2®-r § ©T, 7f 7 7'S 1 

3 4 izMtS £#IZ. S t r e a m # 1 © X MJ - A =f- 9 it ft 
25 MV—>\z IB^T -5 © T , Zfy7s l 4 l (d M tr (7f l 
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4 0 ) 0 

TsTVfS 1 3 4HH0lItXf«; 7" S 1 4 1 J£m©M 

7f-^ ys 1 4 ltlt f-^iH 3 0 © Em p t y |JX>$# 
5 III, 9M<D*f—> (outer-zone) £ J®:& 1 V — > o*o ft 

4 1). 

^ IT, Xr-^S 1 4 1 TlOttfey-> J ©Emp t y [ J ] 
© l*J ^ (C t£ ^ , >/ — > J \Z S t r e a m#-*tm lOXMJ — Ar- 
10 ^ £fEli-r& (Xf 77'S 1 4 2 ) 0 Xt77"S 1 4 2 fC&^TsE 
tTV^ii^T, &ftB#, Empty [J) I' £ tlfc V*— > 
J © T © fl^UC IS gfc £ i££ 7 L fr^J $r L (Xf-^S 14 3), 

^xcdm^ t k^^iit vtz t mm ufc«-er^tt, x^^ys 1 4 

15 , Xr v 7 S 1 4 5 iZMtSo 

Xf^S14 4Tli, St ream (ml) Empty [J) 
© U X h £ i£ JoT £ o ^LT, Empty [J] O'JXh^End 
(■x-^a^t.) <h-r^)o £7t, Fu 1 1 C J ) Kfct, */->J(D 
± X © M \Z IE & ifi & £ tl <h U T . ( 1/ — > J © 5fe p 7 h' l/X, 
20 > J ©7*— -EndOUXhSIfttS. '^1/T,' j* 

" 1 " 79 U/yhlT, i -z>p\mm(D*j->\zi&-t 0 

^K, IHi^^Ttfc^fiJIfb (Xf'^S 1 4 5 ) . IT 
Utifl Xf^'SHei;!*, ,f TUTt^ftntt'. Xr-yy 
S142CS5. 

25 :©j;7f:LT. i o © >/— > ©*T-«sEea<*&7 l& IZ 
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te, S t r e ami^m lCXi •J -AT-^CiTCffli^iT 
ST,. Xf 7 7's' 1 4 2 ~ S I 4 5 ©Il^iO Ilii^e, 

5 ^l/T, Xr^^S 1 4 5 T.S t re am#-%m l©Xh'J-A 

XS?OUXFS v S.tTea.m (mi.).'CS»t«. £ , Em 
Pty [ J ) (1H7 F M'+.l >.^0©7 f -'^i) -*En 

d <D >J X h Srgft L F u 1 1 [ J ] fc « > ( V*- > J ©$fe^ 7 H 
10 UTs. mM-£nfcT F l/XJfOf-^ *) -End-BU^kS: 
ft t 5 . .1 t ^fl v /-'-^ Of fa * Ogjfi i ft 5 

outer-zone £ J fdgg^b ( X 5r y 7° S 1 4 6), Xfy 1 3 2 

iai/fc^r^S13 9i:'H8l:, Xf 1 4 6C^ 

15 ^Tfe, Xf7^S 1 4 3TYe s iM^nfct, Xf^.S 1 
4 5TYe s tfJIfSnfci^Ctt, outer-zone IZJ&mfeTZ 
ffl3ffi©**«ff btlS. Xt-^^S 1 4 6-CYe s iWi 

$ ft B# T , S t reamf^ml<?)XMJ-Af-^!2ll^ 
T^TbT^O. HCJC, Xf7ySl42©iIttHfT$n§Ci 
20 lift £ -§>o 

^±©XT7 7'S 1 4 1 ~ S 1 4 6©lltWJLT. Xf7 7* 

s i 3 4 ~ s i 3 9 <d mm ft £ n , 1*3 JS'tt © V/— > fc S t r 
e am##m 2 07 h U - A ^— * ©ISft^ft $ ft -5 „ 

25 ^JpJBfL. M^#^--Tr fcftfcf, SSJnfc'Sfr e^arnHmxC 
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XI'J-At-^^, f-^120OS,t ream (m x ) CD U 
X h £ # M L;Tff4 C- (X 1 4.8), Xf 7^S 14 2 1: 

giJRfcfc^-C&nfcf, Jg^^nfc S t r e a m#^m x 
CDX h U - Af-^ 5f 1 bX^ 5 S t r earn (m x ) CD U X h 
5 l:^^vJIt5^V->CDEm,p t y l:S t r e am (mx) CD 

u x b zmm-r t&\z\ Himy->©Fui i^bs t r 

earn (mx) C U X> (Xf77'S 1 49). d CDM 

ICiO, =MK E m p tylCS t ream # m x CD X h U — A 5 s 
-^^O.B«JI8t«.**«i61nJSn, liF u l 1 h S t r e a m#*§-m 

10 xoxh'j-A ^- * co bij i$««t © w-ffi^eijRfe sns. 

8iJRfcitJ££*i;fc:S t ream (mx) Cllf s t ream 
( = m y ) $ § j&> H ^ (Xfy^S 15 0), 4B ^ s t r e a m 
#iittltf'(my^ "0" T?*n«), Xf y^S 1 4.2l;R§„ 
— 3f> *B^s t re amA^Stmfci^it m y > m x 7? 
is $> Z> frM WtT % ( X t y X' S 1 5 1 ) . £ CD W m it , S t ream 
#-5§-m y CD 7, h 0 — A^—^ S^J^ 1^ £> 1*1 (C^»jT^ ^ rt^J ®r T 

o cd m s ct o > 2 c h te^-r & « > fl- M \/~ > K 12 ^ 2 n £ X 

h'J-Ar-^roS t r e a m#-5fte, f*j M > /— > tc HE m £ tl £ X 
20 h U — A-x— ^ CD S t r e a m#^- J; D t> 1 O/h £ < Ki» 
5£ £ tl £ o. 

fit, m y > m x & n te\ Xz^^S 1 4 2 1:15*?, m 
y>mxT'^tl(l S t r e am (my) O'JX h^illl, S 
t r e am##myCDX MJ-Af-^^f^X^ l 1 Oi^Hi* 
25 £:b. sfc'fc:. fOl^fc'lfcf-^^S t.r earn (mx) CD U X 
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h&#ll/T, T^Xi' 1 1 Ojznmg&frTZ (X^yy'S 1 5 
2 ) 0 C<DmW£&frlZ, X f 7 7' S 1 4 9 T E m p t y ^ gfc £ 
tl M iC S t r e a mmnmy <D 7, MJ— A^— ^£##jAtf#l 
M~C $> & * 

5 ^(3, Stream (my) © U 7 h M^T > 

(DEmp t ytS t r e am (my) <D V 7> h & 2> £ &\Z > 

M S &y->OFu 1 1^ 6St ream (my) C'JXhS 
I'JB&T£ (Xr^S 1 5 3 ) 0 

dc^M31«, S t r e am#-S§-my<7)7> h U— Ax- ? (D^Mm 
io # ft K # 5 , Emp t y <h F u 1 1 ©Hr^lTS 5. 

IttUT, S t ream (my) C'JXhfS t ream (mx) 
© U 7 h C fi # tft it S . ' * . SifSEmp t y*^S t r e a 
m (my) (£> U X h £ I^T 0 £ l~ , H ^ f £ F u 1 1 tS t 
ream (mx) © U X h $iljDt^. £ fc, XhU- A (mx) 
15 &SJ|{tt5 (7f^S15 4). 

2 c hfB^-r^>^-&, ftm<D£^mt&$:mm-t zmmtw-moQ^ 

1 4 lCS^tS, ofi6©Xr'> &V~>k (k 

20 = 1 ~ 2 n ) OiQf-^^i^Emp t y [ k ) ITI^, 

4 3tz^-r % /->^^©^-<x^ i i o \zmm vr^m& &m t it 

25 H4 4ii, 141, 42, R^4 3©f-^)H 2 0. 1 3 0 £ 
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/t'J 1 5 0±l:^ibfcW4Sfg|T*5'.. /t'J 1 5.0lt 7 
K U X 0 ~ 1 7iTO *0 S3 'ft fett 1 5 1 £ y K U X 1 8 i-glft . 

1 5 2 Si^T^O, $.»3/fbfci#.l 5 1 ^7— 7;V.l 2 0 tf 
-^;H 3 0 ifi&miS n%o &5g«l& 1 5 2IIS tream 

5 ( i ) ( i = 1 ~ 5 ) QiiSO V X h#*M3*l-<5. 

04 frVT , t&ift f*J ^ f$ v ^^E U 1 5 0 ± T K V X IC IE 

tg $ n s u x i.r^s. c: © u x h o ^ m « ( be it 9t m t h 

Endu (o, o, o) Tiuns. 
io ^tu i 5'oo7>'i/7 0i:-tt (o/o.; o) *«»«$n'5. s 

fc . ^ U 1 5 0©7 Hl/X l~5C(i» S t r e a m ( 1 ) ~ ( 5 ) 

^tU 1 5 O07FI/X6-1 7(I«Emp t y ( 1 ) ~ ( 6 ) S. 
ZfF u 1 1 ( 1 ) ~ ( 6 ) C9#fr -?mfct*nZ>7---7 )V 130 

15 g^ns. 

03 9 07D-ff-hO7f^S 13 1 © SjaMfc 4& 3 <£ !K 

1 3 OCrtllt HI 4 4 © 1 Id T ^ ^ id #J $8 
2 *l £ 0 T % fc> ^ , f-^;H 2 OOS t r e am (1) ~ (5) 
l:ttEnd (0, 0, 0 ) • S © $ n * . £ £: > f-^JH 3 0© 
20 Emp t y (1) ~ (6) V— >1 (ZD ~ 6 ( Z 6 ) © 

d©^§^, M«7KU7ttOtS:5. r-7;H 3 0©F 

u i i ( i ) - ( 6 ) izit. (ttfo*/- ><D9tmT ttifcv 

25 12®^— ^Sfc* "0" *fti7KI/Xfe0i^5„ 
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04 6(:St<]:^;, Stream (1) ^Stream 
(2) ©2. ch^H^|H»*<fftotlfcfrs. Stream (1) it 
ft m V — > 6 e> , Stream ( 2 ) « « f*) V — > 1 £ IB ft' 
£n& 0 H CL ~Z? * Stream (1) S t r e a m#^- 1 <D 

5 7. h U -Af 7^ £ , St ream (2)^ St rea m#^- 2 © 

•6*1, — > 1 £ I/— > 6 (C35SiC|Sft L, IEte&«K:4>& 

^v- > i o^tifcx h u - a^-^ 2 ^mm^nrc^m^m 

10 lTl/^ 0 £©8f Stream (2), Emp t y [2] 

&£ZfFu 1 1 C 2 ] © if?} |*J 2§ « 2 CtkT i ^ iC/iSo ClOiSg 

Stream (2) Empty C 1 ] <DV X b iftfetiatsn* 
^fe«7Fl/XiLTlSi«l 52C7F1/X1 8 tl£o 
£fc, Empty Cl] C^ti^iL^StE n d^l^^tl, 

15 Ful 1 Cl] fc^ — > 1 a*±TB3ft»*"r*"5 £ £ fcjrcf ( 1 . _ 
1 84000, 0) z^IS ^ 2 tl 3 0 

^—37 2 V- > 2 (3 SB ft ^tlT2 c h!2i^H7Lfctt^. d 
20 (D^m, 7h'J-AT~^l. 2(D^S1t^«, i4 4® 3 \Z ^ 
ti^ & -5 0 

Stream (1) \Z Empty C6] 0>J X h tJOA, 
T K l/* fc&3K<5tt 1 5207HI/71 9 ^t^t5 c 
25 • Empty [6] CEnd (0. 0, 0) &mi£L. Emp 
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ty(6] \zv-> 6 iz&zm®.mi><Dm®L*mi£Tz>o 

• &mM®.l 5 2 07 h* 1/7 1 SiZ, S t r e am (2) ©fS 

5 o'jxh^^j^-r^o 

T & ^ , 7F 1/X 1 8 1: (184001,1 1600 . 0) <D 

• il3l/->2©«H7h*!/Xi&IfC 1 Empty [2], F 
u 1 1 ( 2 ) 0 U 7 h &miE?Z> B 

10 Empty (2.) S ( 3 0 0 0 0 1, 184000, 0), 

Ful 1 [ 2 ) £ (184001, 11600, 0) tt5. 

• temmig 1 5 207FI^X1 9 C, Stream (1) <£> f E 
iHT^lit^fcfefc, ('/->5Oft07 K 1/7, |$tI7F 

15 (=o)> © u x h 3 c 

-?t£t>% . 7FI/7 1 9il ( 8 3 2 0 0 1, 44000, 0 ) CD 

WifS^->6(D»*lTFl/X^S^, Empty [5). F 
ull C5)©U7h*#EjE'rS. 
20 Empty ( 5 ] ft ( 3 0 0 0 0 1, 876000, 0), 

Ful 1 [53 £ (832 0 01, 44000, 0) 

M ^ T . @48{C^Tc};'5tC < !/->li!/->2^6S t r e 
am (2) ^lUI^LTt t-T^o CO^m, x-^^Stf#«, 114 
4 <£> 4 (C^-Tck "5 JC^M^n^c 
25 T 
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• Emp ty ±T££Mi& tL, F u 1 1 C 1] 

Empty C 1) ^ ( 1 , 1 8 4 0 0 0,0 ), Full CD 
£ ( 1 , 0 , 0 ) i-T^o 
5 • Empty C 2 ) ^^ti^tl, Ful 1 [ 1 ] &gBftflg 

i£*S b it £<■ 

Empty (2)1( 1 8 4 0 0 1, 2000002, 0), 
Ful l (2) * ( 1 8 4 0 0 1, 0, 0) tt5. 

# {C , I4 9l;itj;3l;, Stream (1) ^Stream 
10 (2) **ffi«SnTVifefg«»c^f(i-rs^-^ — i^n V 0 ->a >£ 

fro & tt5. C!CD^^,XhU-A5F-*-^« : S'ltfgtt,El4 4(D 5 
' ^ T J: -5 td ^ M $ tl £ . 
T fc t> *> , 

Stream (1) £ UJ 8Hfc b & , Empty CD © U 
15 X h £Jta*., *©*ttW7KI/X*j£3S««l 5 207 h*l/X2 0 
K 8t ^ f 5 o 

Stream (1) £ ( 1 , 184000, 20) it5. 
Empty CI] (D^^mm^mi, . Ful 1 CI) <£ 

20 Empty C 1 ) 13 ( 0 , 0, 0 ) £ f£ b . Full CD 

£ (1, 18400, 0) 

• feUfgfct 15207FI/^2OI;Stream (1) (Dmm 

mT &&m-r ztcibiz. x k u x 2 0 k , ( , /->2©^i7ki/ 

25 *»«7K>7 (=0)) O'J^hl^tS. 
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7H1/X2 Of: (184001,116000, 0) 

mmV- > 2 ©1^7 H V7. \zm-3% , Empty (2) £ 
Full (2) roUXh^ljEtS, 
5 Empty (2) * ( 3 0 0 0 0 1 , 8 4 0 0 0, 0), F 

u 1 1 ( 2 ) £ (18 4 001, 11600, 0) tt5. 

Emp t y C6] StT^tMH, Ful 1 [6] & IB 

Empty [6] £(1080001, 256000, 0), 
10 Ful 1 [ 6 ] £ (10 80001, 0, 0 ) 

Empty [ 5 ] &±TQ%mm£ L, F u 1 1 C 5 3 £gE 

Empty [ 5 ) £ (83200 1, 248000, 0), 
Ful 1 [53 £ (832001, 0, 0) £ £ e 
15 $n T , HI 5 0 lc ^ T 5 £ , Stream (3) £ S t r e a 
m (4) (D 2 c h |W|P#fe#£: L £ it £ . ^Oif , Stream 
( 3 ) ti^^y- > 6 * ^ . St ream (4) «F*I^/- > 2 
e>IB^T^o IWIlItt, MS t r e amSr^SfcfflftLfcit, £t , 

20 -^flfHtt. 0 4 4 © 6 (C^f =fc 5 \Zt£.2> a 

•t & , 

Stream (4) Empty (2) OU^hSHA. # 
iiTHl'X^Sii^l 5 2©7 KI/X2 1 flight 3 o 

Stream (4) £(300001, 84000, 21) 

25 
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Empty ( 2 ] ©^ti^^ib tWife L , Ful 1 [ 6 ) 

Empty (23 £ ( 0 , 0, 0), Full C 5 D * (8 

3 2 0 0 1,0,0 ) tt5.. 

5 *A\Z. M 5 1 l:*tJ:-5fi:. S t r earn ( 3 ) '*« V— > 6 <D M 
i$i.±fc\zmm-£?irc'&. S t r e am (3) CgOOf-^^'/- 
>5(d» Stream ( 4.) D ©t-^*^/-> 2 CgglStl 

4 £> 7 \Z f" =t ^> IC & £ o 

Stream (3) \Z Empty C 6 3 <D U X h £ JD > 
<D^:t&i^T r I l'X£*fc35&ttl 5 2 ©7 F l*-X 2 2 t^^tl,. 

Empty C 6 3 ©$tgit$il t I, Ful 1 ( 6 3 & 

15 Empty ( 6 3 £ ( 0 , 0, 0), Ful 1 ( 6 ) £ (1 

0 8 0 0 0 1, 2 5 6 0 0 0, 0 ) 

• feli^ 1 5 2C7 H1/7 2 ICS t r earn ( 4 ) OfBfi* 

j^r zmmt z> tc, 7^72 11; o/- > 3 cd&sht' Ki/x, 

K^fe^T £SB»£nfcSU&7 K 1/X ^TCO^-^fi, 

20 iTFUX (=0)) ©U7h^J$TS. 

7 2 1 1: (384001, 216000, 0) 

M IB \/ — >3©1^7HV'X(:S^t, Empty (33 £ 
Ful 1 (3) ©U7hSHiEt5. £ © ^ > Empty (33 
25 U$t««|Li)it). Fu 1 1 C 3 ] te£TB&mmi&mfrt?2>. 
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Empty [ 3 ) £ ( 0 , 0, 0 ) , Full (3 3 £ (3 
84001, 216000, 0) 

• &mm&l 5 2 07 F>7 2 2KS t r e am (3) <£>fB^ 
H7^Iit5fe*(I, 7 H UX 2 2 fc (V-> 5 O^feiT K I/X, 

iirtTFl-X (=0)) OiJ7h ^f^^-T £o . 

7h*UX2.2t:( 8 3 2 0 0 1 , 44000, 0) 

MfB^->5CO*,^THl/XtcS^#, Empty C 5 ) t 
10 Fu 1 1 (5) ©'JXh^liEtS. 

Empty C 5 3 S ( 8 7 6 0 0 1, 20 4000, 0), 
Ful 1 C5] S ( 8 3 2 0 0 1 . 44 000, 0) tt^. 

Z\(D£oiZ. &^t&m$&lZ3$ l>Tte, S t r e am, Emp t y, 

RtfFu i l ©§f-^;HiiD, r^x^csy-xD^fiit 

15 S^'IB^M^Sr^SL, ^ O , & S t r e a mCf-f X ^ ±©f2i 

t m m t & o 

zwrnffimmz. m 5 2 i;stv-> 1 ~ 6 ^t-r^f ^ 1 

25 6 0 *^Jl:LTiitSo r^Xf 1 6 0©7-> 1 O U77^ 



WO 00/42515 



PCT/JP99/05679 



75 

©M KSU7 0KB h) h (KjHM 

I) lil 7. 5 Mbps -tOffi© 1 /— ><£> h ^ >y ^flljjfc* £ 

IV-htt,J5 2l:S.tiOT»5. 

- £ Jt^T{c^T> Xfy yi 1 ) 3 _ 

5 R^tttiB 3 ) a>Ba#n^3^*ofct'r*.. 

Xf^^l : M P E G 2 (6Mbps) X3f t>^iHl 8Mbps 
: MPEG2 (6 Mbps) X2ft >^;i/ = 1 2 Mbps 
Xt7 7'3 : M P E G 2 (6Mbps) X4f t> ; fil/=2 4Mbps 

^T^HIfC, Xr-> y 1 - 3 OjEft^fe* ft^tS. 
Xf7^1 : V*-> 1 ty-> 2 ©*8£#l#ttfl6tt 18. 7 5 M 
15 bps TSO, Xf7 7'l CDl^ItttiiD feB^OT, !/ — > 1 
t V- > 2 tC^M^-frTlB^-r^o 

7x77*2 : V* — > 1 (D&m. V— V (=17. 5 Mbps ) (i, 7 

7T773 : V-> 2 hV—> 6 <£> *g fig « 2 5 Mbps T* 
20 & 0 . 7t7 7 3 ©^^l*ttgj: 0 *> ^ l> K> T , 7->2i>/- 
> 6 fC^fc$-&TsB#-r^)c 
^5 3 tt. ±&Lfc%Z 1 tf)3!J£0il£>7 x 7 7 1 ~ 3 <DB&tJj&& 

77 7 7"i©i^it i^bi (a) ts-r £ -s k:, s-r. V*->1 

25 iCChl, Ch2, Ch 3©7D77T-^^y-7>yt;H;!B 
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^11. 1 /->2lliiL < 7->2CCh 1« Ch 2, Ch 
3 <D&<D~?U y Z^r— 9 £~>-^r > is V )l\ZU&-$r Z> . f LT, S 
7->ll;flL, Ch 1, C h 2 , Ch30*©^D^f 
— ^*S^ — tr>->^ Jl\zUm-T^ e d © «k 5 t£ , 3^^>*JK7)^ 
5 P y ^ 5 s - ^ £ V- > 1 £ V/— > 2 3£ S \Z % WL 12 0 b T V> < o 

x^- y ? 2 <Dm&u. mm ( t> ) &c 5k -r <£ -5 f;: , y-zitch 

1, Ch2, Chi, Ch2... COIH^T, 7 U y $ — 9 £ fflti 
IT H < o 

Xf7^3 0i^(t |W| [H (c) t^tioC, X f 7 7 S 1 <h 
10 I^HCLT, 4ft>^i^yDy^r-^ (Chi, Ch2, C 
h3, Ch4) 7->2t , /->6l;x5i: < > - > ~> ^ ;U 

# tc i£ ^ & m 2 © mmm a , v/- > m m m m < *> - * n# ^ > 

t ^ -t 7s m m = i o o ms x y - > m mm 

20 ti£.m-?z>o 

v - > mmmit .m<D v - > iz&m-t z> t£iz&&-e 1 0 omsot 
15 oms) <dt ? -txmm&m-r z> h<D tmfeL . &m-?z>v-> 
^mmmizmnx^ z>m. ^•; k (D^mmmizitmvxT z ±xm 
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X t- v 7° 1 : 18 Mbps ( 3 c h fBfiO O^^^^tttgCJf H, 
T (1 0 0 ms) ^^•^Tfe^'&^^tt^ (= (2 0 + 2 

2. 5) xo. 9/2) ^mm^m^^m^^^ v- > 2 £ v- 

>3£jiiRL.T, Chl-Ch3C^n^f-^4, 7->2t 
5 V- > 3 t^StCfS^T^o 

X^^y°2 : 1 2 Mbps (2 c hfBfiO CD $g g ^ fC *f L T 
te, 7->lffigil/-h (=17. 5 ms) f~ ttT + ^-ic^f&T^ 
£ © Ch 1 tCh 2CT)^D^^^-^^y->i<D^.(csB^T 
£ o d CD J® , T ^ -fe * 8f PeSHi 0 i: & & 0 
10 Xf : ^3 :2 4Mbps ( 4 c h IB^) CD^-^^^tttg L T > 
7 ?-£Xmm (1 0 Oms) £^*e>T fe^^^Jttt^ (= (27. 5 
+ 30) X0. 9/2) 7^&^g5fcttfg£±lHl£ >/- > 5 £ V- 
>6£}liRLT. Ch l~Ch4©^D7^f-^$, y->5i 

15 i5 4ii ±m vfrm, 2 (D^mmmcDx^ v y 1 ~ 3 <Dmm^m^ 

XfyyiCi^it jlJEI (a) t~ ^ T =fc 5 , £-r\ y->2 
tCh 1, Ch2, Ch 30^O7^T-^^y-^>yt;H:aE 
^L, ^{3, !/-> 3 I; 5 Ois T^lil, y->2tCh h C 
20 h2, Ch 30^©yny^T-^£y-y>>'t;Hc8Bfit5. 

LT, f?73\ v/— > 2 I: 5 0 ms T^IL, Chi, Ch2, C 

h 3c7)^c7)yn^^ t^— ^ £ > x * jnzmm-r Z> . Z\ <D <fc a 

IC, 3 ft >^^©^P^^ t"— ^ £ y— >2t V— > 3 52 S (I , 
*> - *r > v )V \z ft Wl IB m L t n < „ 

25 X^- y 7° 2 (DMSte. mm (b) \Z^T \Z, V - > 1 \Z C h 
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1, Ch2. Chi, Ch'2. v .OilfT, ~f P y 9 $ & |B# 
LT'W< 0 
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5 > 6 K^SKiHfifc-r £<> £C0i§£-«, 4 >*)V<DUmU<D 

T , >/- > 5 C h 1 t C h 2 CO 'x — ^ £ , , /->6©Ch3iC 
h 4 co ^ — 5> £ 1 5 M ~? 3 o 
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t i, x n it & <d m v - > ^ en 7 — & <d m m <d m & t z> 
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U ;* > FHSty->5: l^f^l^iCit (7f r^S 2 0 6) B 
«\ 7f^S201tRD, 1 V- >tztfftmm<D V — >^CD|H 
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14. z c l vKis-^iufcM^ff t>nsiH»«E*(ct^-r s« 
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then break; else cont=1 ; } 
f(cont=1) braek) 



inz=l :ouz=J; 
zone=1 : channle=1 ; 
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For (! = inz:2n:++l) 
{ i f (Empty [ I ] <D V- XD^r-^M) >0) 
break;] 
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Empty.Cll^'JXHrtSLV 7"-> I \Z 
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Stream (channe I ) iCEmpty [ t ] OT I 7*0'V^ 

Empty [I ] = (»*£ 7 KbX+1.Sf-^I) (End) : 
Fu I I [ I ] = (5*337 K L/X. SESt^* a) (End) : 
channe 1 «■+ : 



No 
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channe i > k ? 
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Empty[l]CDWSiig£ 
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Empty [I ] = (End) ; 

FuM [l] = (5fesST KL/X. y-XD^r-* 
1=1+1 : 


3) (End) : 


1 «4 S 1 72 
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For (J=ouz;2n;++1) 




{ i f (Empty [J] (ft */- l/CD^r' $ at) >0) 


break: | 






, S175 





Empty[J]0)UXHrffit\ */->JlC 
(channe I ) 1 P *v 2 £ SE» : 

Stream (channel) It Empty [J]<7}l y *J 

Empty [J] = (»**7 ^T-^S) (End) ; 

Ful 1 [J] = (5t!i7 FUX. ISS^-^S) (End) : 
channe I ♦+ : 



No 
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Yes 
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No 



&npty[J]a>'JXHMt$ 
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jYes 


S179 




/ 




Empty [J] = (End) ; 






Ful 1 [J] = (fti7 KUX. 7-><Df- 


(End): 




jxj+t : 






e> 1 on 
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filSi $ ftfcStream (mx) <D 
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feS $ tlfcSt ream (mx) (DUX h 
UBifi^SEmptyClStream (mx) (D 
HjK^^FuI I A>bStreara(mx)(D 




© 



S187 


Stream (my) (D'JXh 5 & 

Kft-tULv StreamdnxXD'JX K 




i 


S188 


Stream (my) (7) 'J X Hcttl* 
fflS^"-5EmptylCStream(my) <D 

fHJjil"3~€>Ful Ut^<bStream(my)<D 


SJ89 






Stream (my) (D'jXhS 

Stream (mx) (75 'J 7. h iiStS ; 

IHI3l"3"'5Empty7^ t> Stream (my) CD 
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B93^"-&Ful l(CStream(mx)05 



H5 8 



WO 00/42515 



PCT/JP99/05679 



5& 
"57 



m 2 = m 
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i = m + 1 ffi^-stream =0 / 



For ( I = i nner-zone ; 2 n ; ++ 1 ) 
{ if ((Empty [I ] O S)> O) 

break;} 



Empty[l]<D'jX hfC|£^SB|Jk ; 
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No 
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S194 



Stream(m2)(CEmpty[l]<D'JX h£i&An: 
Empty [ I ]= (End) ; 

Full[l] = (5fe^T h'L/X, V-XDT-SiM) (End); 
1=1+1 ; 
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Stream(m2)(Cfg^$+tfc^^7' KUX$T'i!3 
'J X f- £SAD ; 

Empty [l] = (g$*T K UX+U J^T^S) (End) ; 
Full[l]=(5fe^T KUX, I5&T-SS) (End); 
innei — zone=l ; 
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For (J=outer- zone; 1 ; — 1) 
{ if ((Empty [J] CD V~XD- 
break; ) 



? -*«)>0) 
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Empty[J]<7>"jX KICC£LV I 4 /->|C 
(channel) 5^ >*JKD I ^Q'^ £fBS ; 
Stream (channel) iCEmpty [J] CD1 ~3u *y <7 
h^iliJO; 

Empty [J] = (ii7>'U7.+ K SH?-**) (End) ; 
Fu I I [J] = (5fcHT K UX, K»^-'* g) (End) ; 
channe I ++ ; 



S202 
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Empty [J] = (End) ; 

Ful I [J] = (£SI7 KUX, ffiffc-T*-**) (End) 
J = J-1 ; 
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outer-zone = J ; 



S207 



S208 



RETURN 



3 



H6 O 



INTERNATIONAL SEARCH REPORT 



International application No. 

PCT/JP99/05679 



A. CLASSIFICATION OF SUBJECT MATTER 

Int. CI 7 G06F13/10, 340, 3/06, 302, H04N5/85, G11B20/10 



According to International Patent Classification (IPC) or to both national classification and IPC 
B. FIELDS SEARCHED 

Minimum documentation searched (classification system followed by classification symbols) 

Int. CI 7 G06F13/10, 340, 3/06, 302, H04N5/85, G11B20/10 



Documentation searched other than minimum documentation to the extent that such documents are included in the fields searched 
Jitsuyo Shinan Koho 1926-1996 Toroku Jitsuyo Shinan Koho 1994-1999 

Kokai Jitsuyo Shinan Koho 1971-1999 Jitsuyo Shinan Toroku Koho 1996-1999 

Electronic data base consulted during the international search (name of data base and, where practicable, search terms used) 



C. DOCUMENTS CONSIDERED TO BE RELEVANT 



Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


X 
A 


Nikkei Electronics, 07 November, 1994, (07.11.94), 
"Searching for the HDD Control System Suitable for 
Multi-media", p. 169-178 


1,8,10 ! 
2-7, 9, 11-27 


A 


US, 5717641, A (Victor Company of Japan, Limited) , 

10 February, 1998 (10.02.98) 

& JP, 9-46691, A & EP, 759677, A 


1-27 


X 
A 


JP, 9-330566, A (Hitachi, Ltd.), 

22 December, 1997 (22.12.97) (Family: none) 


12, 19, 23 
1-11, 13-18,20- 
22,24-27 


X 
A 


JP, 9-91879, A (Hitachi, Ltd.), 

04 April, 1997 (04.04.97) (Family: none) 


13,20,24 
1-12,14-19,21- 
23,25-27 


Y 
A 


EP, 798710, A (Toshiba Corporation), 

01 October, 1997 (01.10.97) 

& JP, 9-259537, A & US, 5914928, A 


14,21,25 
1-13, 15-20, 22- 
24,26, 27 


Y 


JP, 10-214455, A (Hitachi, Ltd.), 


14,21,25 



Further documents are listed in the continuation of Box C. See patent family annex. 



* Special categories of cited documents: 

U A W document defining the general state of the art which is not 

considered to be of particular relevance 
"E" earlier document but published on or after the international filing 

date 

"L" document which may throw doubts on priority claim(s) or which is 
cited to establish the publication date of another citation or other 
special reason (as specified) 

"O" document referring to an oral disclosure, use, exhibition or other 
means 

a P" document published prior to the international filing date but later 
than the priority date claimed 



U T* later document published after the international filing date or 
priority date and not in conflict with the application but cited to 
understand the principle or theory underlying the invention 

"X** document of particular relevance; the claimed invention cannot be 
considered novel or cannot be considered to involve an inventive 
step when the document is taken alone 

U Y" document of particular relevance; the claimed invention cannot be 
considered to involve an inventive step when the document is 
combined with one or more other such documents, such 
combination being obvious to a person skilled in the art 

w & w document member of the same patent family 



Date of the actual completion of the international search 
11 January, 2000 (11.01.00) 


Date of mailing of the international search report 
25 January, 2000 (25.01.00) 


Name and mailing address of the ISA/ 

Japanese Patent Office 

Facsimile No. 


Authorized officer 
Telephone No. 



Form PCT/ISA/210 (second sheet) (July 1992) 



INTERNATIONAL SEARCH REPORT 


International application No. 

. PCT/JP99/05679 


C (Continuation). DOCUMENTS CONSIDERED TO BE RELEVANT 


. Category* 


Citation of document, with indication, where appropriate, of the relevant passages 


Relevant to claim No. 


A 


11 August, 1998 (11.08.98) (Family: none) 




1-13, 15-20,22- 
24,26, 27 


X 
Y 
A 


EP, 701251, A (Canon Inc.), 

13 March, 1996 (13.03.96) 

& JP, 8-203142, A & US, 5818811, A 




15, 18, 22, 26 
16,27 
1-14,17, 
19-21,23-25 


Y 
A 


EP, 827139, A (Sharp Corporation), 
04 March, 1998 ' (04 . 03 . 98) , 
& JP, 10-124879 




15,16,18, 
22,26, 27 
1-14,17, 
19-21,23-25 



Form PCT/ISA/2 10 (continuation of second sheet) (July 1992) 



iffiUS^ PCT/J P9 9/0 5 6 7 9 



A. *W^**-SjMF*>jMH (HBMWWHfr (I PC) ) 

Int C1 T G0 6F 1 3/1 0, 3 4 0, 3/0 6, 3 0 2, H04N5/85, GUB20/10 



W*«rtfofc*/JxPfi*» (BKEWIfdfll (IPC) ) 

■Inter G06F13/I0, 3 4 0, 3/0 6, 302, H04N5/85, G11B20/10 



BTtmxmmmsm 1926-1996^ 

0*H^BBHffl»f36^« 1 9 7 1-1 9 9 9^ 

0*fflS«Hffl«rS6^a 1 9 94- 1 9 9 9* 

0*SHffiSf3BSa^« 1996-1999* 



^■x^ y — * 






X 
A 


BgiU^fB^^, 1 994^11^70^ 7. llfl. 
1 9 9 4 (0 7. 1 1. 9 4) r-^/U^f'-f TJCiiLfcHDD© 
•WP^SrjjRSj P • 16 9-178 


1, 8, 10 
2-7, 9, 11-27 


A 


US, 5717641, A (B3fcif^ «S£#tfc) 10. 2 
^. 1998 (10. 02. 98)&JP, 9-46691, A& 
EP, 75 9677, A 


1-27 


X 
A 


JP, 9-330566, A (flcS^th S SdRf^f ) 2 2. 12 
Ji. 1997 (22. 12. 97) (77 5 9-ftL) 


12, 19, 23 
1-11, 13-18, 
20-22, 24-27 



t><D 



ttj HRfflK0Xtt«3feea^43**ixfcS:illt-c*>or 



11. 0 1. 0 0 



2 5.01.00 



0*@#ffrr (I SA/J P) 
100-8915 
ft ffl EU^BET § 4^3-^ 



is mm 



5R 



9 2 9 8 



WB*-^ 0 3-3 5 8 1 



110 1 ftlfe 3 5 6 5 



i^PCT/ISA/2 10 (® 2 (1 9 9 8*7^) 



mmmm^^r. PCT/JP99/OS679 



$\mxm<n 
Jj7~ =ty — * 



x 

A 



Y 
A 



Y 
A 



X 
Y 
A 



Y 
A 



JP, 9-9 1 8 7 9, A (tt3£^tfcB&«fE3f) 4. 4 JT 
9 9 7 (0 4. 0 4. 9 7) (7r5y-ftU 



EP, 7 9 8 7 1 0, A (^tsttlS) 1. lOfl. 1997 
(01. 10. 97) &JP, 9-2 5 9 5 3 7, A&US, 59 
1 4 9 2 8, A 



J P, 1 0-2 1 44 5 5, A ($fc^ttB3dRf£Bf) 11. 8 
M. 1998 (1 1. 08. 98) (77^- fcU 



EP, 701251, A (*Mr/>1*5aegrtfc) 13. 3,8. 19 
9 6 (1 3. 0 3. 9 6) &JP, 8-20 3 1 4 2, A&US, 
5818811, A 



EP, 827139, A — !7HcSt#*fc) 4. 3M. 19 9 

8 (04. 03. 98) & JP, 10-124879 



13, 20, 24 
1-12, 14-19, 

21- 23, 25-27 

14,21,25 
1-13, 15-20, 

22- 24, 26, 27 



14, 21, 25 
1-13, 15-20, 
22-24, 26, 27 

15, 18, 22, 26 

16, 27 
1-14, 17, 
19-21, 23-25 

15, 16, 18, 
22, 26, 27 
1-14, 17, 
19-21. 23-25 



«JCPCT/I SA/2 10 0g2-<— iS<om%) (1 998¥7fl) 



(12) INTERNATIONAL APPLICATION PUBLISHED UNDER THE PATENT COOPERATION TREATY (PCT) 



(19) World Intellectual Property Organization 
International Bureau 

(43) International Publication Date 
8 August 2002 (08,08.2002) 




PCT 



(10) International Publication Number 

WO 02/062061 Al 



(51) International Patent Classification 7 : H04N 5/93 

(21) International Application Number: PCT/US0 1/47062 

(22) International Filing Date: 

5 November 2001 (05. 1 1.2001) 



(25) Filing Language: 

(26) Publication Language: 



English 
English 



(30) Priority Data: 

09/7 1 7,980 21 November 2000 (21.11 .2000) US 

(71) Applicant and 

(72) Inventor: MELBY, Alan, K. [US/US]; 1223 Aspen Av- 
enue, Provo, UT 84604 (US). 

(74) Agent: NICHOLS, Steven, L.; Suite 150, River Park Cor- 
porate Center One, 10653 S. River Front Parkway, South 
Jordan, UT 84095 (US). 

(81) Designated States (national): AE, AG, AL, AM, AT, AU, 
AZ, BA, BB, BG, BR, BY, BZ, CA, CH, CN, CO, CR, CU, 



CZ, DE, DK, DM, DZ, EC, EE, ES, FI, GB, GD, GE, GH, 
GM, HR, HU, ID, IL, IN, IS, JP, KE, KG, KP, KR, KZ, LC, 
LK, LR, LS, LT, LU, LV, MA, MD, MG, MK, MN, MW, 
MX, MZ, NO, NZ, PL, PT, RO, RU, SD, SE, SG, SI, SK, 
SL, TJ, TM, TR, TT, TZ, UA, UG, US, UZ, VN, YU, ZA, 
ZW. 

(84) Designated States (regional): ARIPO patent (GH, GM, 
KE, LS, MW, MZ, SD, SL, SZ, TZ, UG, ZW), Eurasian 
patent (AM, AZ, BY, KG, KZ, MD, RU, TJ, TM), European 
patent (AT, BE, CH, CY, DE, DK, ES, FI, FR, GB, GR, IE, 
IT, LU, MC, NL, PT, SE, TR), OAPI patent (BF, BJ, CF, 
CG, CI, CM, GA, GN, GQ, GW, ML, MR, NE, SN, TD, 
TG). 

Published: 

— with international search report 

— before the expiration of the time limit for amending the 
claims and to be republished in the event of receipt of 
amendments 

For two-letter codes and other abbreviations, refer to the "Guid- 
ance Notes on Codes and Abbreviations" appearing at the begin- 
ning of each regular issue of the PCT Gazette. 



(54) Title: METHOD AND SYSTEM FOR CONTROLLING AND ENHANCING THE PLAYBACK OF RECORDED AUDIO- 
VISUAL PROGRAMMING 



EFRtfle 
(^00) 



J 



o 

o 




intelligent 


video disc ptayer 
(500) 


User interface 
device 
(505) 




Video disc drive 
(501) 








Transceiver 
(503) 




disc drive 
(507) 




(57) Abstract: A system for controlling playback of a video program recorded on an optical disc or other recording medium uses an 
electronic data file (100) that is independent of, but corresponds to, the video program recorded on the recording medium (106). The 
electronic data file provides a hierarchicaj segmentation of the video program and associates supplemental information with various 
segments of the video program. Consequently, the user can access the supplemental information to learn more about that segment 
of the video program or screen that segment for potentially objectionable content The user may also edit the playlist of segments in 
the electronic data file to control the playback of the video program. 
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TITLE OF THE INVENTION 

Method and System for Controlling and Enhancing the Playback of 
Recorded Audiovisual Programming 

FIELD OF THE INVENTION 

The present invention relates to the field of video recording and playback. 
More specifically, the present invention relates to the field of prepared video 
productions for educational and entertainment use. The present invention 
encompasses a novel software package for controlling and enhancing the playback 
of a pre-recorded video program, where the software package allows the viewer to 
edit the playback of the video program for selected content, access supplemental 
information about the program content and monitor the effect of the editing 
decisions on the playback of the program. 

BACKGROUND OF THE INVENTION 

Television and cinema provide a vast array of available video 
programming. By watching a television broadcast or attending a film showing, a 
viewer can experience almost any type of video programming he or she desires. 
Additionally, in order to make such video programming even more accessible to 
viewers, such video programming may be recorded on such media as video 
cassettes or optical discs for playback using an appropriate recording and playback 
device at the viewer's convenience. 

Being able to play back a recorded video program also provides the viewer 
with greater control over how that video program is viewed. For example, if a 
viewer wishes to replay a portion of the video program, he or she may do so using 
the playback device. Similarly, if the viewer wishes to skip over a portion of the 
video program he or she may fast forward through the program using the playback 
device. 
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If the video programming is on an optical disc, such as a CD-ROM, laser 
disc or Digital Video(Versatile) Disc ( <C DVD"), the reader of the playback device 
can quickly access any portion of the video program. If the optical disc playback 
device is incorporated into a computer, for example, and controlled by the 
computer, the user may specify what portions of the video program and in what 
order those portions should be played by the playback device. 

For example, U.S. Patent No. 5,109,482 to Bohrman discloses a video 
playback and control system in which the viewer may access all the frames in a 
recorded video program, and specify segments of the program by a starting and 
ending video frame such that only those segments specified by the viewer are 
replayed. Moreover, the viewer may indicate the order in which segments are to 
be replayed and associate with each segment textual comments relating to the 
segment. 

Similarly, U.S. Patent No. 5,434,678 to Abecassis discloses a system for 
controlling the playback of a video program in which segments of the program are 
specified and rated as to potentially objectionable subject matter they contain. 
Using a computer or other user interface device for controlling playback under the 
principles of the Abecassis system, the user specifies a rating for categories of 
potentially objectionable subject matter above which the viewer does not wish to 
see rated material. The video program, as recorded, contains alternative sequences 
and video segments which have various ratings of potentially objectionable 
content contained therein. The playback device will then automatically select and 
substitute those segments of the video program which match the preferences 
established by the user for objectionable content in the replay of the video 
program. 

While systems such as those disclosed by Bohrman and Abecassis provide 
viewers with a great deal of control over the playback and content of a recorded 
video program, they fail to allow the viewer to monitor the impact such editing has 
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on the video program. Consequently, there is a need in the art for an improved 
video playback control system which allows the viewer great flexibility in 
controlling potentially objectionable content in a video program, but also allows 
the viewer to monitor the impact any editing has on the video program. 

Additionally, the prior art systems generally require that any supplemental 
information or commentary regarding the various scenes of the video program be 
input by the user or recorded on the same medium as the video program. 
Consequently, there is a need in the art for a more flexible way of providing a user 
with supplemental information about the segments and segment content of a 
recorded video program, particularly where no such information was originally 
included on the same recording medium as the video program. 

In connection with these aspects of the art, the prior art systems present the 
recorded video program and any divisions thereof in a flat, linear list. 
Consequently, there is a need in the art for a method and system of better 
organizing a structure associated with a recorded video program to permit more 
rapid and easy navigation by the user among the segments of the program and any 
information associated therewith. 

Other systems related to the use of video programming have addressed the 
desire of viewers to edit out objectionable content. One such device is a program 
for dynamically editing the content of a video program which is broadcast to the 
viewer's television set. In these systems, a signal which indicates the presence 
potentially objectionable subject matter in each segment of the broadcast program 
is included in the broadcast signal in a field which is also used for carrying 
close-captioned text for the video program. The system then monitors this signal 
from the close-captioning field and compares the objectionable nature of the 
program as indicated by the incoming signal with a preset preference provided by 
the user that defines a rating above which programming content should be avoided. 
When the signal from the closed-captioning field of the video broadcast signal 
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indicates material in conflict with the preference setting provided by the user, the 
system may appropriately mute the audio or blank the video output to remove the 
objectionable content from the video program. 

This system, unfortunately, only works if the appropriate rating information 
is provided in the closed-captioning portion of the video programming signal. If 
this is not the case the system will have no ability to edit the programming 
according to the desires of the user. Moreover, this system must simply divide 
potentially objectionable subject matter into relatively broad categories which can 
then be selected or refused by the user. The user has very little control to precisely 
define what he or she may consider objectionable and remove only that material 
from the video program. Finally, the use of video rating information in the 
closed-captioning portion of the video signal requires additional processing of the 
signal by the receiver and playback equipment and prevents the full use of that 
portion of the signal for closed-captioning or other information that may be carried 
there. 

Consequently, there is a need in the art for an improved method and system 
of allowing a user to remove those scenes or audio portions of a video program 
which that user finds objectionable. There is a further need in the art for such a 
system to allow the user great flexibility in determining precisely that subject 
matter which he or she finds objectionable and removing only that subject matter 
from the video program. 

SUMMARY OF THE INVENTION 

The present invention meets the above-described needs and others. 
Additional advantages and novel features of the invention will be set forth in the 
description which follows or may be learned by those skilled in the art through 
reading these materials or practicing the invention. The advantages of the 
invention may be achieved through the means recited in the attached claims. 
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In summary, the present invention may be embodied and described as a 
novel video playback system for playing back a video program recorded on an 
optical disc or other recording medium. This system includes a video playback 
device connected to a reader for reading the video program stored on the recording 
5 medium, the reader being controlled by the video playback device. The video 

playback device controls playback of the video program in accordance with a user- 
editable electronic data file existing in the video playback device independent of 
data recorded on the recording medium. 

The electronic data file includes a user-editable playlist that specifies a 
1 o division of the segments of the video program as recorded on the recording 
medium. The electronic data file preferably also includes supplemental 
information associated with the specified segments of the video program. 

The video playback device also preferably includes a user interface 
including a display device on which the playlist is displayed. The displayed 
15 playlist provides a listing of the segments of the video program and may also 

provide a coding system that indicates what types of the supplemental information 
are associated with each segment. The playback device can then access and 
display the supplemental information under control of a user operating the user 
interface. 

20 Using the user interface, the user can also make changes to the playlist. 

The playback device records the changes to the playlist made by the user through 
the user interface. Thus, the electronic data file may include an original and an 
edited playlist. 

The electronic data file may also provide a description of each of a number 
25 of audio segments of the video program. The user can edit the playlist to remove 

any of the audio segments from the playlist so that the removed audio segment is 
omitted from a playback of the video program. The playback device also records 
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such deletions of audio segments from the playlist in the edited playlist of the 
electronic data file. 

The system may also preferably generate a statistical analysis of 
characteristics of the video program as played back in accordance with the edited 
playlist. This analysis may be conducted directly on the edited playlist or in 
comparison with an unedited version of the playlist. This analysis will provide 
such data as the running time of the edited program, damage to the plot of the 
program arising from the editing and types of supplemental information associated 
with remaining video segments. 

The present invention also encompasses the methods of making and 
operating the system described above and the method of generating the electronic 
data file described above. For example, the present invention encompasses the 
method of controlling and enhancing playback of a video program recorded on an 
optical disc or other recording medium by controlling playback of the video 
program with a video playback device in accordance with a user-editable 
electronic data file existing in the video playback device independent of data 
recorded on the recording medium. 

The present invention also encompasses the method of providing an 
electronic data file for use in controlling playback of a corresponding video 
program recorded on an optical disc or other recording medium. This method 
includes dividing the video program as recorded on the recording medium into a 
hierarchy of segments; and storing the hierarchy in an electronic data file 
independent of data recorded on the recording medium. This method, consistent 
with the description above, may also include the addition of supplemental 
information stored in the electronic data file and associated with various video 
segments. 

The present invention also encompasses a method of doing business in 
which customers are provided with a means for controlling and supplementing 
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playback of a video program recorded on a recording medium. This method 
includes selling an electronic data file that corresponds to the video program on the 
recording medium, where the electronic data file includes a user-editable playlist 
that divides the video program into video segments and includes supplemental 
information associated with one or more of the video segments. This data file, as 
described above, is usable to control playback of the video program on a video 
playback device. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings illustrate the present invention and are a part 
of the specification. Together with the following description, the drawings 
demonstrate and explain the principles of the present invention. 

Fig. 1 is diagram of a system according to the present invention for 
producing a multi-platform file that supplements and facilitates editing of a pre- 
recorded video program. 

Fig. 2 is a flowchart illustrating the operation of the software of the system 
of Fig. 1. 

Fig. 3 is a diagram of the content of a pre-recorded video program and the 
hierarchical structure of that content according to the multi-platform file of the 
present invention. 

Fig. 3 a is a diagram of a second division of the content of a pre-recorded 
video program and the hierarchical structure of that content according to the multi- 
platform file of the present invention. 

Fig. 4 is a diagram of a video program playback system according to the 
present invention. 

Fig. 5 is a diagram of a second embodiment of a video program playback 
system according to the present invention. 
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Fig. 6 is an illustration of the editing system, multi-platform file and 
playback devices of the present invention. 

Fig. 7 is a flowchart illustrating the operation of the software of the 
playback system of Figs. 4-6 according to the present invention. 

Fig. 7a is an illustration of a hierarchical tree of the playlist of the present 
invention. 

Fig. 8 is a diagram of additional divisions of the content of the pre-recorded 
video program for supporting the audio editing features of the present invention. 

Fig. 9 is a flowchart illustrating an additional analysis feature of the 
software of the present invention. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 

The present invention provides a method and system for controlling and 
enhancing the playback of recorded audiovisual programming. More specifically, 
the present invention provides systems for generating and using an electronic data 
file that divides the recorded audiovisual program into segments and provides 
supplemental information about the various segments of the program. This 
electronic data file can be used by a number of different playback platforms and 
allows the user to easily edit the playback of the program for appropriate content 
and access supplemental information about program segments. 

Fig. 1 illustrates a system according to the present invention for generating 
the multi-platform data file that corresponds to and supplements a recorded video 
program. This file is referred to herein as an Electronic Film Review or "EFR" 
file. 

As shown in Fig. 1, the system of the present invention for generating an 
EFR (100) preferably includes a computer (108) with an optical disc drive (107). 
As will be understood by those skilled in the art, the principles of the present 
invention can be applied to recorded video programming that is recorded on, for 
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example, a CD-ROM, a laser disc or a Digital Video(or Versatile) Disc ("DVD"). 
The term "optical disc" will be used to refer generally to these and any equivalent 
video storage media. 

The invention may also be applied to a recorded video program stored on 
other data storage media including, but not limited to, a magnetic disc, a magneto- 
optical disc, or semiconductor memory. The term "recording medium" will be 
used herein to refer to all such recording media on which a video program can be 
recorded, including, but not limited to, optical discs, magnetic and magneto-optical 
discs, and semiconductor memory unit. 

The computer (108) preferably includes a modem and connection (102) to 
the Internet or World Wide Web (101). Consequently, the EFR may be sold and 
distributed over the Internet (101). 

The computer (108) also has a monitor (103) on which the video program, 
recorded on the optical disc (106) and retrieved by the optical disc drive (107), is 
shown. With user input devices, such as the keyboard (104) and mouse (105), a 
user can divide the recorded video programming into a hierarchy of segments. 
Additional data can then be associated with each segment which supplements the 
segment, describes the segment or identifies potentially objectionable subject 
matter in the segment. As used herein, a "segment" refers to any specified portion 
of the recorded video program at any hierarchical level, including the entire video 
program. 

The divisions of the video programming into segments and the additional 
information associated with each segment are written to an EFR file (100) which 
exists independently of the programming recorded on the disc (106). The EFR file 
(100) is preferably written in a multi-platform markup language, such as 
Extensible Markup Language (XML) using Unicode to encode the characters. 

The creation of the EFR (100) is done using a video software package 
running on the computer (108). Fig. 2 is a flowchart of this software package and 
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illustrates the method of creating an EFR (100) under the principles of the present 
invention. 

As shown in Fig. 2, the optical disc drive, under control of the video 
software package, reads the data for the video program from the optical disc (201). 
The program, under control of the user, is then displayed on the monitor of the 
computer. The video program consists of a series of frames, still images, that are 
displayed in rapid succession to give the illusion of motion. The user can specify a 
video segment by indicating a starting frame and an ending frame. Each frame 
may be numbered to facilitate selection and identification by a user who is 
defining video segments. 

As the user defines video segments (203), the segment parameters, i.e., an 
identification of the frames that begin, end and are included in the segment are 
written to the EFR file (204). After a segment is identified, the user may provide 
additional data associated with any of the segments (205). This information may 
be background or critical information about the film or the particular segment, 
cultural or linguistic information about the segment, a synopsis of the segment, an 
identification of potentially objectionable content in the segment, a rating of the 
importance of the segment to the plot of the program, etc. Any information the 
user wishes to associate with that segment may be input (205), including numeric 
values or alphanumeric codes that characterize aspects of the segment. The user 
may also designate various types or categories of such additional information. 
This additional data is then written to the EFR (100). All such information, 
whether graphic, textual, animated, etc., is referred to herein as "supplemental 
information." 

This process continues until the user has finished (207), i.e., has defined all 
the video segments desired and entered all the desired supplemental information. 
When the process is finished, the software completes the EFR file (208), which 
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includes the divisions of the video programming and all the supplemental data 
provided by the user. 

Fig. 3 illustrates in more detail the hierarchical division of the video 
program written to the EFR (100). The example illustrated in Fig. 3 is that of a 
DVD (320). When manufactured, the DVD (320) already includes some division 
of flie recorded programming into various segments. As shown in Fig. 3, the 
material on a DVD is generally divided into a preview section (302), a main 
segment consisting of the video program (301) and a trailer segment (303) which 
may include out-takes from the video program, director's notes or comments, 
behind the scenes footage, explanations of how the film was made, etc. The video 
program's main segment (301) is usually divided in to a number of chapters (304). 
Consequently, when a user plays a commercial DVD, he or she can choose to 
watch a preview, a trailer or the main program and, within the main program 
(301), can select a particular chapter (304) at which to start watching. Thus, box 
(330) indicates the hierarchical structure provided on a conventional DVD. 

Box (33 1), however, illustrates additional hierarchical structure and 
divisions of the main program (301) provided in the EFR (1 00) of the present 
invention. Each of these segments is preferably defined by identifying a first and 
last frame for that segment. The hierarchical structure is for the convenience of 
the user in navigating through the defined segments of the program (301). As 
shown in Box (33 1), each chapter (304) is divided into a number of scenes (305). 
Each scene (305) is divided into a number of sub-scene segments (306). Finally, 
each sub-scene (306) is divided into a number of clips (307). As used herein, the 
term "clips" refers generally to segments of the video program at the bottom level 
of the hierarchy illustrated in Fig. 3. The divisions between the preview (302), 
main segment (301) and trailer (303), and between the chapters (304) in the main 
segment (301) may also be written into the EFR (100). 
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The user may choose to provide supplemental information for any segment 
(304-307) at any hierarchical level in the system (33 1). However, information 
supplementing each clip (307) is preferred and gives the user the most detailed 
information and control over the video program (301). 

Fig. 3 a illustrates a second embodiment of the hierarchical structure of the 
segmentation of the video program. According to the principles of the present 
invention, there may be more than one hierarchical structure dividing a recorded 
video program, with all alternate hierarchical structures being stored in the EFR 
(100). As shown in Fig. 3a, a chapter (304) may have a first hierarchical structure 
of segments (331) as illustrated and described in Fig. 3. The same chapter (304) 
may also have a second hierarchical structure of segments (331a) that divides the 
chapter in a different way. 

One segmentation scheme (e.g., 331) may be best suited to editing the 
video program for presentation in an educational context. The alternative 
segmentation scheme (e.g., 33 la) may be best suited to editing the video program 
for entertainment use. Consequently, two or more alternate segment hierarchies 
may be produced and include in the EFR (100) of the present invention. 

Fig. 4 illustrates a system according to the present invention for using an 
EFR (100) to support and control the playback of the corresponding video 
programming. The exemplary system of Fig. 4 includes a computer (408) which 
includes an optical disc drive (107), e.g., a DVD drive, for playing back video 
programming recorded on an optical disc (106), e.g., a DVD. The video 
programming from the disc (106) is displayed on a monitor (403) of the computer 
(408). As will be understood by those skilled in the art, the computer (408) may 
be, for example, a desk-top computer, a lap-top computer, a server or other 
computer system. The computer (408) is controlled through its user interface, e.g., 
the keyboard (104), mouse (105) and display (103). 
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Under the principles of the present invention, the user of the optical disc 
(106) will also want to acquire an EFR file (100) that corresponds to the 
programming on the optical disc (106), i.e., the EFR (100) delineates a hierarchical 
structure of segments of the video program on the disc (106), such as that shown in 
Fig. 3, and provides supplemental information about various segments of the video 
program recorded on that disc. As will be described in detail below, a video 
playback software package running on the computer (408) will use the data from 
the EFR (100) to enhance the user's enjoyment of the programming on the disc 
(106) and allow the user to better control the playback of that programming. 

The EFR file (100) may be provided to the computer (408) in any of a 
number of ways. As illustrated in Fig. 4, the EFR file (100) may be transmitted to 
the computer (408) via the Internet (101) and connection (102). Alternatively, the 
EFR file (100) may be recorded on some medium readable by the computer (408). 
For example, the EFR file (100) may be recorded on a floppy disc (41 1) or CD- 
ROM (410) from which the EFR file (100) can be read into the computer (408). 

Fig. 5 illustrates an alternative playback platform under the principles of 
the present invention. As shown in Fig. 5, the playback device for the optical disc 
(106) may be an intelligent video disc player (500). As used herein, the term 
"intelligent video disc player" refers to a playback device for reading video 
programming from an optical disc, which playback device operates under the 
control of a software package that accepts and utilizes an EFR file (100) to 
enhance the user's enjoyment and control of the playback of .the programming on 
the disc (106). 

The intelligent video disc player (500) shown in Fig. 5 includes a video 
disc drive (501) that can read video programming from a video disc and output 
that programming to a connected television set or monitor (550). The player (500) 
also preferably includes a user interface device (505), such as a keypad and display 
on the housing of the player (500), with which the user can control the player 
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(500). The user interface device (505) is preferably supplemented by a remote 
control unit (405) which communicates wirelessly with a transceiver (503) in the 
intelligent player (500). 

The EFR file (100) may be delivered into the player (500) in any of a 
number of ways. Similar to the computer system described above in Fig. 4, the 
intelligent player (500) may have a connection (502) to an external network, such 
as the Internet or a cable television system. This connection (502) may be used to 
transmit an EFR file (100) to the player (500). Alternatively, the player (500) may 
include a disc drive (507) which can accept a floppy disc (41 1) or CD-ROM (410) 
bearing an EFR file (100). In yet another alternative, the video disc driver (501) 
may be able to read a CD or CD-ROM and may read an EFR file (100) from such 
a disc prior to accepting the optical disc (106) from which the corresponding video 
program is read. 

Fig. 6 illustrates the important principle that the EFR file (100), generated 
on the system (108) illustrated in Fig. 1, can be accepted and used by a number of 
playback platforms (601). Examples of potential playback platforms (601) 
include, but are not limited to, a personal computer with a DVD drive, an Apple® 
computer, an intelligent DVD player, a Sony® Playstation2 or a Microsoft® 
Xbox. 

Fig. 7 is a flowchart detailing the playback software package of the present 
invention that accepts and utilizes an EFR file (100). As noted above, this 
software package may be adapted to run on any playback platform with 
appropriate modification. This adaptation does not affect the package's ability to 
accept and utilize any EFR file (1 00). This is due, in the preferred embodiment, to 
the fact that the EFR file (100) is an XML file. 

As shown in Fig. 7, the playback platform running the playback software 
package of the present invention (e.g., 408) will display a playlist using the data 
from the EFR (100). The playlist is a hierarchical listing of the divisions of the 
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video program illustrated in Fig. 3. Because this data is stored in the EFR (100), 
the playlist may be reviewed and edited with or without the corresponding optical 
disc (320). 

Preferably, the playlist is displayed using a tree structure as shown in Fig. 
7a. With the tree structure, the user can expand or close any branch of the 
hierarchy that the user wishes to see or work with. As shownin Fig. 7a, the user 
interface of the software package diagramed in Fig. 7 preferably displays the 
playlist (750) as a listing of divisions of the video program on the optical disc. 
Below each listed segment, an indented listing of the subdivisions of that segment 
can be accessed by selecting the icon (753, 754) associated with the listing for that 
segment. 

As shown in Fig. 7a, the listing for the "Main Segment" has a "boxed 
minus" icon associated therewith. This indicates that the listing of subdivisions 
within the "Main Segment," i.e., the "Chapters," is displayed. The user could hide 
the listing of Chapters and subsequent subdivisions by selecting the "boxed minus" 
icon associated with the listing "Main Segment." 

Similarly, Hie listing for Chap 1 includes a "boxed plus" icon (753), 
indicating that the subdivisions within Chap 1 are not presently listed in the 
playlist (750). These subdivisions of Chap 1 could be shown in an indented list 
under "Chap 1" if the user selects the ,r boxed plus" icon (753). In contrast, the 
icon (754) associated with the listing for Chap 2 is a "boxed minus" indicating that 
an indented listing of "Subscenes" within Chap 2 is displayed. 

The playlist (750), if partially or wholly expanded to list tfie various 
subdivisions of the video program segments, may exceed the capacity of the 
monitor (751) on which the user interface is being displayed. Consequently, a 
scrolling mechanism for moving through the display playlist on the monitor will 
preferably be provided. Such mechanisms are well-known in the art and would be 
controlled through the user interface of the playback device. 
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The playlist (750) may also include a coding device that advises users when 
and what type of supplemental material is associated with the various subdivisions 
of the video program. In the example shown in Fig. 7a, each listing for a clip may 
include a number of differently colored dots (752). Each color of the dots (752) 
may represent a different type of supplemental information that is associated with 
that clip. For example, a red dot may be included with the listing for any clip ibr 
which there is a textual plot summary included in the EFR. A blue dot may be 
included with the listing for any clip in which there is potentially objectionable 
subject matter. A green dot may be included in the listing for any clip for which 
there is historical or cultural background information included in the EFR. 

Any type of information associated with a clip may be designated by a 
particular color of dot or any other distinguishing character, symbol, icon, graphic, 
etc. Additionally, the coding system may be applied at any level of the hierarchy 
and not just at the "Clip" level. At any hierarchical level, the elements of the 
coding system (e.g. colored dots) may have associated therewith a number that 
gives an indication of how may subdivisions within that listing include 
supplemental data of that type or how much data of that type is included within 
those subdivisions. 

Returning to Fig. 7, the playback platform running the playback software 
package of the present invention (e.g., 408) will display a playlist using the data 
from the EFR (701). The user may then select a clip or other division of the 
hierarchy to work with (702). At the clip level, a menu or listing of the 
supplemental information associated with that clip will be displayed (703). The 
user may then explore the additional information associated with the clip (704). 
As noted above, the supplemental information may be of almost any type 
including, but not limited to, cultural notes, linguistic notes, plot summary, 
reviews and critiques, historical or other background notes, and a description of 
potentially objectionable subject matter. (705). 
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la addition to accessing the supplemental information, the user may also 
edit the playlist (706). In editing the playlist, the user may rearrange the order of 
segments or remove segments from the playlist so that those segments are skipped 
during playback of the video program. .The user may also specify that some of the 
supplemental information contained in the EFR be displayed during playback to 
supplement or replace a corresponding video segment 

When the user has finished editing the playlist (707), the edited playlist is 
stored (71 1). If the user makes no edits to the playlist of the EFR (708) and then 
initiates playback of the unedited playlist (709), the entire video program is played 
(710) in the manner recorded on the optical disc. In other words, if the user does 
not edit the playlist and if the initial playlist is complete, a playback of the video 
program is the same as would be the case if the user had no ability to edit the 
playlist and were not using an EFR of the present invention. 

It should also be noted that the user can edit the playlist and store an edited 
playlist using an EFR (100) of the present invention without having possession of 
the corresponding optical disc containing the video program. Portions of the video 
program itself, except perhaps single frames or quotations for indexing purposes, 
are preferably not included in the EFR (100). 

If an edited playlist is produced and stored in the EFR (100), and the user 
then initiates playback (712) of the corresponding video program from an optical 
disc using the playback software package diagrammed in Fig. 7, the video program 
is played back subject to any changes in the sequence of segments or omission of 
segments dictated by the edited playlist (713). This may also include displaying a 
textual description of a segment or information regarding that segment included in 
the EFR (100) to supplement or replace the segment itself. 

Consequently, the EFR and playlist of the present invention may be of great 
use to parents and educators who are displaying a video program for children or 
younger age groups and who may consequently wish to remove potentially 
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objectionable content from the playback. This gives the user great flexibility in 
deciding precisely what type of content in the video program is objectionable and 
allows the user to remove only that content. Moreover, the user need not 
experience the content he or she finds objectionable during editing, but can instead 
read a textual description of that content in the information associated with that 
clip or video segment in the EFR ( 1 00) of the present invention. 

Fig. 8 illustrates an additional feature of the present invention. The EFR 
(100) may, in addition to the hierarchical divisions of the video program on a 
corresponding optical disc, also include a division of audio segments (310) within 
each clip. Each audio segment (310) will correspond to a word or phrase within 
the clip (307). The EFR (100) may contain a non-specific description of the 
language or a verbatim listing of the language in each audio segment (310). 
Consequently, any inappropriate word or phrase can be removed from the playlist 
as edited by the user. 

Finally, Fig. 9 illustrates another feature of the playback software package 
of the present invention. As shown in Fig. 9, the user may initiate an analysis of 
an edited playlist (801). The analysis feature of the software will then provide an 
assessment of the edited playlist. The analysis may be on the edited playlist alone 
or on the edited playlist in comparison to the original unedited playlist (802). 

Without a comparison to the original playlist, a number of important 
analyses can be performed on the edited playlist. For example, an indicator of the 
relevance of each video segment to the plot of the video program may be 
associated with that segment in the EFR (100) of the present invention. This 
indicator may be a numeric value or an alphanumeric code. Consequently, the 
analysis feature can assess and quantify damage done to the plot of the program by 
the removal of various video segments from the playlist. Additionally, the 
analysis feature may provide statistics on the edited playlist such as the amount of 
time required for playback. The analysis feature may also indicate the number of 
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segments remaining that include any one or all of the various types of 
supplemental information. For example, the analysis feature may indicate that a 
particular number of the included segments contain indications or descriptions of 
potentially objectionable subject matter and may divide that potentially 
5 objectionable subject matter in categories and degrees. These statistics are 

generated (806) and then displayed for the user (807). 

If the user desires a comparison to the unedited playlist, the original playlist 
is retrieved (803) and analyzed in comparison with the edited playlist. For 
example, the amount of running time for each playlist, edited and unedited, may be 
io compared. These statistics are generated (804) and then displayed for the user 

(805). 

In another aspect of the present invention, if the user has deleted a clip or 
segment from the playlist, and that deleted segment has associated therewith an 
indicator of relevance to plot that is greater than a predetermined threshold, i.e., 

15 the deleted segment is highly relevant to the plot, the playback software package 

of the present invention may automatically display a textual description of the 
deleted segment in place of the segment to prevent the gap in plot that would 
otherwise occur in playback due to the deletion of the segment. Additionally, it 
should be understood that at any point in time during playback, using the playback 

2 o software package of the present invention, the user can pause the playback and 

access the supplemental information associated with that or another segment of the 
video program. 

Finally, using the playback software package of the present invention, the 
user may designate one or more types of supplemental information that are of 
2 5 particular interest in the purpose for which the user is playing back the video 

program. The playback software may then advise the user during playback when a 
particular segment of the video program has supplemental information of the 
designated type or types associated therewith. The user may then pause the 
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playback and access the information or instruct the playback software to 
automatically pause at such a point and display the relevant supplemental 
information. 

This feature may also be tied to an indicator as to the significance of the 
supplemental information such that only supplemental information of the 
designated type which is coded as having a particular level of significance is 
advertised to the user during playback. This can minimize disruption to the 
playback if so desired by the user. 

The preceding description has been presented only to illustrate and describe 
the invention. It is not intended to be exhaustive or to limit the invention to any 
precise form disclosed. Many modifications and variations are possible in light of 
the above teaching. 

The terms "playback platform" are "video playback device" are used herein 
to refer generally to those devices, such as the computer (408) and intelligent 
video player (500), that run the playback software package of the present invention 
and control an optical disc drive to playback a recorded video program in 
accordance with an edited or unedited playlist of an EFR of the present invention. 

The preferred embodiment was chosen and described in order to best 
explain the principles of the invention and its practical application. The preceding 
description is intended to enable others skilled in the art to best utilize the 
invention in various embodiments and with various modifications as are suited to 
the particular use contemplated. It is intended that the scope of the invention be 
defined by the following claims. 
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WHAT IS CLAIMED IS: 

1 . A video playback system for piaying back a video program recorded 
on a recording medium, the system comprising: 

a video playback device; and 

an recording medium reader for reading a recording medium on which said 
video program is recorded, said reader being controlled by said video playback 
device, 

wherein said video playback device controls playback of said video 
program in accordance with a user-editable electronic data file existing in said 
video playback device independent of data recorded on said recording medium; 
and 

wherein said electronic data file includes a user-editable playlist that 
divides said video program as recorded on said recording medium into at least one 
hierarchy of video segments. 

2. The system of claim 1, wherein said electronic data file further 
comprises supplemental information associated with at least one of said segments 
of said video program, 

3. The system of claim 2, wherein said supplemental information 
includes an alphanumeric code that rates a characteristic of said associated 
segment. 

4. The system of claim 3, wherein said playback device generates a 
statistical analysis of characteristics of said video program as played back in 
accordance with said edited playlist based on said alphanumeric code. 
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5. The system of claim 2, wherein: 

said system further comprises a user interface including a display device on 
which said playUst is displayed; and 

said displayed playlist comprises a listing of said segments of said video 
program and a coding system that indicates what types of said supplemental 
information are associated with each said segment. 

6. The system of claim 2, wherein said system further comprises a user 
interface, where said playback device accesses and displays said supplemental 
information under control of a user operating said user interface. 

7. The system of claim 1, wherein said playback device further 
comprises a user interface and records changes to said playlist made by said user 
through said user interface. 

8. The system of claim 7, wherein: 

said electronic data file further comprises a description of each of a 
plurality of audio segments of said video program; and 

said playback device records deletions of audio segments from said playlist 
made by said user through said user interface. 

9. The system of claim 7, wherein said playback device generates a 
statistical analysis of characteristics of said video program as played back in 
accordance with said edited playlist. 

10. A method of controlling and enhancing playback of a video program 
recorded on a recording medium, said method comprising controlling playback of 
said video program with a video playback device in accordance with a user- 
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editable electronic data file existing in said video playback device independent of 
data recorded on said recording medium, wherein said electronic data file includes 
a user-editable playlist that specifies a hierarchical division of segments of said 
video program as recorded on said recording medium. 

1 1 . The method of claim 10, further comprising enhancing playback of 
said video program by associating supplemental information in said electronic data 
file with at least one of said specified segments of said video program. 

12. The method of claim 1 1 , further comprising 

displaying said playlist comprising a listing of said segments of said video 
program; and 

displaying a coding system that indicates what types of said supplemental 
information are associated with each said segment. 

13. The method of claim 11, further comprising accessing and 
displaying said supplemental information under control of a user operating a user 
interface of said video playback device. 

14. The method of claim 10, further comprising recording an edited 
playlist in said electronic data file, said edited playlist including changes to said 
playlist made by said user through a user interface of said video playback device. 

1 5. The method of claim 14, further comprising comparing said playlist 
to said edited playlist to slssqss an impact of said changes made to said playlist by 
said user. 
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1 6. The method of claim 14, further comprising analyzing said edited 
playlist to determine characteristics of said edited playlist 

17. A method of providing an electronic data file for use in controlling 
playback of a corresponding video program recorded on a recording medium, said 
method comprising: 

dividing said video program as recorded on said recording medium into a 
hierarchy of segments; and 

storing said hierarchy in an electronic data file independent of data 
recorded on said recording medium. 

1 8. The method of claim 1 7, further comprising associating 
supplemental information with one or more of said segments, said supplemental 
information being recorded in said electronic data file. 

19. A method of doing business in which customers are provided with a 
means for controlling and supplementing playback of a video program recorded on 
a recording medium, said method comprising selling an electronic data file that 
corresponds to said video program on said optical disc, wherein said electronic 
data file includes a user-editable playlist that divides said video program into video 
segments and includes supplemental information associated with one or more of 
said video segments, said data file being usable to control playback of said video 
program on a video playback device. 

20. The method of claim 1 9, wherein said playlist divides said video 
program into a hierarchy of video segments. 
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21. The method of claim 19, further comprising delivering said 
electronic data file to a customer via the Internet 
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DESCRIPTION 

OPTICAL DISC, 

OPTICAL DISC RECORDING METHOD AND APPARATUS, AND 
5 OPTICAL DISC REPRODUCING METHOD AND APPARATUS 

Technical Field 

The present invention relates to an optical disc for recording still 
picture data and audio data to be produced simultaneously with the still 
10 picture, an apparatus and a method for recording such an optical disc, 
and an apparatus and a method for reproducing such an optical disc. 

Background Art 
Digital cameras 

15 Digital cameras for capturing still pictures using the JPEG 

compression format, formally known as the ISO/IEC 10918-1 standard, 
have become widely available in the last few years. One reason for the 
growing popularity of digital cameras is the improved audio-visual (AV) 
processing capability of modern personal computers (PC). 

20 Images captured by a digital camera can be transferred by various 

means, including semiconductor memory, floppy disk, and infrared 
communications, to a PC in a format enabling the image data to be 
processed and manipulated on the PC. The captured image data can 
then be edited on the PC for use by presentation programs, word 

25 processors, and by Internet content providers. 

Digital cameras enabling audio to be captured with still pictures 
have been more recently introduced. This ability to capture sound with 
still pictures has helped to further differentiate the digital camera from 
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conventional film-based still cameras. 

Fig. 7 shows the relationship between still picture data (JPEG 
data) and audio data recorded by such a digital camera. As shown in Fig. 
7, the still picture data (JPEG data) and audio data are stored in 
5 separate files. Each time a picture is taken (recorded), separate JPEG 
data and audio data files are created. 

There are two basic methods for managing the relationship 
between still picture data (JPEG data) and audio data files. The first, as 
shown in Fig. 7(a), uses a link manager to maintain the relationship (link) 

10 between a JPEG data file and the associated audio data file. The other, 
as shown in Fig. 7(b), assigns the same root file name (the part of the 
file name minus the extension, e.g., H xyz" in Fig. 7(b)) to both the JPEG 
data file and the audio data file. 

Using either of the above-described methods, an audio data file 

15 can be linked to a particular still picture data file when the picture is 
captured, and can be changed during any later editing process. That is, if 
the user decides after taking a picture that the audio associated with that 
picture is inappropriate or undesirable, different audio data can be 
selected and linked to the image data on the PC. 

20 The advent of MPEG (Moving Picture Experts Group) standards for 

handling audio-video data containing moving and still pictures together 
with audio has also accelerated the development of multimedia products 
and services based on MPEG standards. 

When image data and audio are recorded using the MPEG 

25 standard, the audio stream and video stream are multiplexed and 
recorded as a single system stream as shown in Fig. 6(c). This makes it 
very difficult to freely change the audio stream associated with a 
particular video stream after the initial recording. More specifically, to 
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change the audio data recorded for a particular still picture, the still 
picture data and audio data must be edited together as a single MPEG 
system stream. This means that the MPEG system stream must first be 
decoded, and the extracted still picture data and audio data must then be 
5 re-encoded as a single system stream after editing. Editing the still 
picture data and audio data after recording is therefore much more 
difficult than it is with a conventional digital camera. 

Disclosure Of Invention 

10 An object of the present invention is therefore to provide a 

recording medium, an apparatus, and a method whereby audio data 
presented with a still picture can be freely and easily changed even after 
recording the still picture data using an MPEG standard format. 

To achieve the above object, a recording medium according to the 

15 present invention that is reproducible by a reproducing apparatus having 
a decoder buffer, decoder, and output section, has recorded thereto a 
video part stream, such as a first system stream, (ST1) comprising a 
plurality of units containing still picture data for at least one picture, and 
an audio part stream, such as a second system stream, (ST2) comprising 

20 one or a plurality of units containing audio data to be reproduced with the 
still picture data. The units of these system streams store time stamp 
information indicative of a time required for a decoding process and 
output. This time stamp information includes a time SCR2 at which the 
last unit in the first system stream is input to a decoder buffer, and a time 

25 SCR3 at which the first unit in the second system stream is input to a 
decoder buffer. These times SCR2 and SCR3 are defined to satisfy the 
equation 

SCR2 + Tp < SCR3 
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where Tp is the time required to completely one unit to a decoder buffer. 

By the above arrangement, the second system stream carrying the 
audio data is stored in the optical disc independently of the first system 
stream. Thus, the data in the second system stream can be easily 
5 revised. 

Preferably, the time stamp information further includes a time 
SCR1 at which the first unit in the first system stream is input to a 
decoder buffer. In this case, times SCR1 and SCR2 are defined as: 

SGR1 = 0 

10 SCR2 + Tp < 27000000 (27 MHz) 

where (27 MHz) indicates that the numeric value shown therebefore is a 

count of a 27 MHz clock. 

By this arrangement, the time period for transferring the first 

system stream completely to the decoder buffer can be set to 1 second 
15 or less. 

Yet further preferably in this case, time SCR3 is defined as SCR3 
= 27000000 (27 MHz). 

By this arrangement, the transfer start time of the second system 
stream to the decoder buffer can be set to 1 second after the start 
20 transfer time of the first system stream to the decoder buffer. 

Yet further preferably, the time stamp information also includes a 
time PTS1 at which the first system stream is presented from the output 
section, and a time PTS3 at which the second system stream is output 
from the decoder. In this case, times PTS1 and PTS3 are the same. 
25 By this arrangement, the still picture produced by the first system 

stream and the sound produced by the second system stream can be 
effected simultaneously. 

Yet further preferably, the time stamp information also includes a 
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decoding start time DTS1 at which a decoder starts decoding the first 
system stream. This time DTS1 is defined as: 

DTS1 = 90000 (90 kHz) 
where (90 kHz) indicates that the numeric value shown therebefore is a 
5 count of a 90 kHz clock. 

By this arrangement, the decode start time of the second system 
stream can be set to 1 second after the start transfer of the first system 
stream to the decoder buffer. 

In this case, times PTS1 and PTS3 are preferably defined by the 
10 equation: 

PTS1 = PTS3 = 90000 (90 kHz) + Tv 
where (90 kHz) indicates that the numeric value shown therebefore is a 
count of a 90 kHz clock, and Tv is the video data frame period. 

By this arrangement, the presentation of the still picture and the 
15 sound can be done after 1 second plus 1 frame period Tv from the start 
transfer of the first system stream to the decoder buffer. 

First and second system stream management information (Volume 
information) is further preferably recorded to an optical disc according to 
the present invention, and the management information for the first 
20 system stream includes an identification flag (Audio_Flag) for declaring 
there is audio data to be reproduced synchronized with the still picture 
data. 

By this identification flag, it is possible to detect whether or not the 
sound accompanies the still picture. 
25 An optical disc recording apparatus for recording a system stream 

containing still picture data and audio data to be reproduced with the still 
picture data to an optical disc according to the present invention 
comprises an encoder and a system controller. The encoder generates a 
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first system stream (ST1) comprising a plurality of units containing still 
picture data for at least one picture, and a second system stream (ST2) 
comprising one or a plurality of units containing audio data to be 
reproduced with the still picture data. The system controller stores in 

5 said units time stamp information indicative of a time required for a 
decoding process and output. The time stamp information includes a 
time SCR2 at which the last unit in the first system stream is input to a 
decoder buffer, and a time SCR3 indicative of a time at which the first 
unit in the second system stream is input to a decoder buffer. These 

10 times SCR2 and SCR3 are defined to satisfy the equation: 
SCR2 + Tp < SCR3 
where Tp is the time required from the start to the end of inputting one 
unit to a decoder buffer. 

By the above arrangement, the second system stream carrying the 

15 audio data is stored in the optical disc independently of the first system 
stream. Thus, the data in the second system stream can be easily 
revised. 

The system controller of this optical disc recording apparatus 
further preferably stores as time stamp information a time SCR1 at which 
20 the first unit in the first system stream is input to a decoder buffer, and a 
time PTS1 at which the first system stream is output from the output 
section. These times SCR1, SCR2, and PTS1 are defined as: 
SCR1 = 0 

SCR2 < 27000000 (27 MHz) - Tp 
25 PTS1 = 90000 (90 kHz) + Tv 

where (27 MHz) indicates that the numeric value shown therebefore is a 
count of a 27 MHz clock, (90 kHz) indicates that the numeric value 
shown therebefore is a count of a 90 kHz clock, Tp is the time required 
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to transfer the last unit of the first system stream, and Tv is the video 
data frame period. 

By this arrangement, the time for start transferring the first system 
stream to the decoder buffer is set to 0, the time for finish transferring 
5 the first system stream to the decoder buffer is set to 1 second or less, 
and the time for displaying or presenting the still picture is set to 1 
second plus 1 frame period Tv from the start transfer of the first system 
stream to the decoder buffer. 

Further preferably, the system controller further stores as time 
10 stamp information a time PTS3 at which the second system stream is 
output from the decoder. In this case, times SCR3 and PTS3 are defined 
as: 

SCR3 = 27000000 (27 MHz) 

PTS3 = 90000 (90 kHz) + Tv. 
15 By this arrangement, the time for transferring the second system 

stream to the decoder buffer can be set to 1 second from the strart 
transfer of the first system stream, and the time for decoding and 
reproducing the sound can be set to 1 second plus 1 frame period Tv. 

The system controller further preferably generates first and second 
20 system stream management information, and stores in the management 
information for the first system stream an identification flag (Audio_Flag). 
This flag is used for declaring whether there is audio data to be 
reproduced synchronized with the still picture data. 

By this identification flag, it is possible to detect whether or not the 
25 sound accompanies the still picture. 

The system controller yet further preferably records audio data 
reproduction time (Cell_Playback_Time) in the management information 
for the second system stream. 
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By this arrangement, it is possible to set the sound reproducing 

time. 

An optical disc reproducing apparatus for reproducing an optical 
disc according to the present invention comprises a decoder buffer, a 
5 decoder, an output section, and a system controller. When the system 
controller detects that the identification flag (Audio_Flag) is set, it 
synchronously reproduces still picture data in the first system stream and 
audio data in the second system stream. 

By this arrangement, it is possible to previously detect whether or 
10 not the sound accompanying the still picture exists. 

Preferably, when the system controller detects that the 
identification flag (Audio_Flag) is set, a decoder completely decodes one 
picture of still picture data recorded to the first system stream and sends 
the decoded data to the output section, and another decoder then 
15 decodes while reproducing audio data stored to the second system 
stream. As a result, presentation of still picture data from the output 
section begins with the start of audio presentation. 

By this arrangement, it is possible to decode the still picture data 
in the first system stream and the audio data in the second system 
20 stream in separate time periods. 

The present invention also provides an optical disc recording 
method for recording a system stream containing still picture data and a 
separate system stream containing audio data to be reproduced with the 
still picture data to an optical disc according to the present invention. 
25 In addition, the present invention also provides an optical disc 

reproduction method for reproducing an MPEG stream recorded to an 
optical disc according to the present invention. 
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Brief Description Of Drawings 

Fig. 1 is a block diagram of a DVD recording apparatus drive; 

Figs. 2(a) and 2(b) show the relationship between address space 
on a disc and the amount of data stored in the track buffer; 
5 Figs. 3(a) and 3(b) show the correlation between I, B, and P 

pictures in an MPEG video stream; 

Fig. 4 shows the structure of an MPEG system stream; 

Fig. 5 is a block diagram of an MPEG system stream decoder 
(P_STD); 

10 Figs. 6(a), 6(b), 6(c) and 6(d) show video data, the change in the 

amount of data stored to the video buffer, a typical MPEG system stream, 
and an audio data signal, respectively, according to prior art; 

Figs. 7(a) and 7(b) illustrate links between still pictures and audio 
in a digital still camera, according to prior art; 

15 Figs. 8(a) and 8(b) are diagrams showing two different styles of a 

directory structure and the physical arrangement of the disc recording 
surface; 

Figs. 9(a) and 9(b) show the structure of a management 
information file, and the data stream; 
20 Figs. 10(a), 10(b) and 10(c) show the management information 

data for still picture data and audio data, a data stream for the still 
picture data and audio data, and another data stream for the still picture 
data and audio data; 

Figs. 11(a), 11(b) and 11(c) are diagrams showing a still picture 
25 data VOB, an audio data VOB, and a combined VOB, according to the 
present invention; 

Fig. 12 is a block diagram of a DVD recording apparatus; 

Fig. 13 is a flow chart of a recording process of the DVD recording 
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apparatus shown in Fig. 12; 

Fig. 14 is a flow chart of the still picture data VOB generating 
process shown as step S1301 in Fig. 13 in the DVD recording apparatus 
shown in Fig. 12; 

5 Fig. 15 is a flow chart of the audio data VOB generating process 

shown as step S1303 in Fig. 13 in the DVD recording apparatus shown in 
Fig. 12; 

Fig. 16 is a flow chart of the management information file 
generating process shown as step S1304 in Fig. 13 in the DVD recording 
10 apparatus shown in Fig. 12; 

Figs. 17(a) and 17(b) are explanatory views showing two still 
pictures; 

Figs. 18(a), 18(b), 18(c), 18(d) and 18(e) are diagrams showing an 
operation according to the prior art to reproduce a still picture with an 
15 audio data; 

Figs. 19(a), 19(b), 19(c), 19(d) and 19(e) are diagrams showing an 
operation according to the present invention to reproduce a still picture 
with single audio data; and 

Figs. 20(a), 20(b), 20(c), 20(d) and 20(e) are diagrams showing an 
20 operation according to the present invention to reproduce a still picture 
with dual audio data. 

Best Mode for Carrying Out the Invention 

The preferred embodiments of the present invention are described 
25 below with reference to the accompanying figures. 

A preferred embodiment of the present invention is described 
below with reference to a DVD recording apparatus using DVD-RAM as 
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the MPEG stream recording medium. 

1 . Overview of a normal MPEG stream 

A normal MPEG stream of audio-video data is described first 
5 below. The structure of the MPEG stream will be known to those with 
ordinary knowledge of the related art, and the following description 
therefore focuses on those parts having a particular relationship to the 
present invention. 

As previously noted above, the MPEG standard defines an audio- 

10 video compression method that has been formalized as the ISO/IEC 
13818 international standard. 

The MPEG standard achieves high efficiency data compression 
primarily by means of the following two features. 

First, moving picture data is compressed using a combination of 

15 conventional intraframe compression using a spatial frequency 
characteristic to remove intraframe redundancy, and interframe 
compression using temporal correlations between frames to remove 
redundancy in adjacent frames. Even more specifically, the MPEG 
standard compresses moving picture data by first categorizing each 

2D frame (also referred to as a picture in MPEG parlance) as an I picture 
(intra-coded frame), P picture (a predictive-coded frame that is coded 
with reference to a preceding picture), or a B picture (a bidirectionally 
predictive-coded frame that is coded with reference to both a preceding 
and a following picture). 

25 The relationship between I, P, and B pictures is shown in Fig. 3. 

As will be known from Fig. 3, P pictures are coded with reference to the 
closest preceding I or P picture, and B pictures are coded with reference 
to the closest preceding and following i or P pictures. As also shown in 
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Fig. 3, the picture display order and the coding order of the compressed 
data are different because each B picture is also dependent on an I or P 
picture that is presented after the B picture. 

The second feature of MPEG compression is dynamic (coding) 

5 data allocation by picture unit based on image complexity. An MPEG 
decoder has an input buffer for storing the input data stream, thus 
enabling a large (coding) data size (that is, more data) to be allocated to 
complicated images that are more difficult to compress. 

MPEG also supports MPEG audio, a separate MPEG encoding 

10 standard for audio data to be reproduced with moving picture data. In 
addition, however, MPEG also supports the use of various other types of 
audio encoding for specific applications. 

The present invention allows for two types of audio data encoding, 
that is, encoding with data compression and encoding without data 

15 compression. Exemplary audio encoding methods with data compression 
include MPEG audio and Dolby(R) Digital (AC-3); linear pulse code 
modulation (LPCM) is typical of audio encoding without data 
compression. Both AC-3 and LPCM are fixed bit rate coding methods. 
MPEG audio can select from among several different bit rates on an 

20 audio frame unit basis, although the range of bit rates is not as great as 
that available for video stream coding. 

The MPEG system then multiplexes the encoded moving picture 
data and audio data into a single stream, which is referred to as the 
MPEG system stream. This multiplexed moving picture data and audio 

25 data is commonly referred to as AV data. 

The structure of the MPEG system stream is shown in Fig. 4. As 
shown in Fig. 4, the MPEG system stream is a hierarchical structure of 
packs and packets containing a pack header 41, packet header 42, and 
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payload 43. 

The packet is the smallest multiplexing unit, and the pack is the 
smallest data transfer unit. 

Each packet comprises a packet header 42 and payload 43. AV 
5 data is divided into segments of an appropriate size starting from the 
beginning of the AV data stream, and these data segments are stored in 
the payload 43. The packet header 42 contains a stream ID for 
identifying the type of data stored to the payload 43, and a time stamp 
used for reproducing the data contained in the payload 43. This time 
10 stamp is expressed with 90 kHz precision. Data types identified by the 
stream ID include moving picture and audio. The time stamp includes 
both a decoding time stamp DTS and presentation time stamp PTS. The 
decoding time stamp DTS is omitted when decoding and presentation 
occur simultaneously, as with audio data. 
15 A pack typically contains a plurality of packets. In this preferred 

embodiment of the present invention, however, one pack contains one 
packet. Thus, one pack comprises pack header 41 and one packet 
(comprising packet header 42 and payload 43) as shown in Fig. 4. 

The pack header 41 contains a system clock reference SCR 
20 expressing with 27 MHz precision the time at which the data in that pack 
is input to the decoder buffer. 

A decoder for decoding the above-noted MPEG system stream is 
described next below. 

Fig. 5 is a block diagram of a model MPEG system decoder 
25 (P_STD), particularly showing the detail of decoder 16. Shown in Fig. 5 
are: a system controller 51 with a system time clock STC, an internal 
reference clock for the decoder; a demultiplexer 52 for demultiplexing, 
that is, decoding, the system stream; a video decoder input buffer 53; 
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video decoder 54; a re-ordering buffer 55 for temporarily storing I and P 
pictures in order to absorb the delay between the display order and 
decoding order that occurs between I and P pictures and the dependent 
B pictures; a switch 56 for adjusting the output sequence of the I, P, and 
5 B pictures in the re-ordering buffer 55; an audio decoder input buffer 57; 
and an audio decoder 58. 

The operation of this MPEG system decoder when processing an 
MPEG system stream is described next. 

When the time indicated by the STC 51 matches the system clock 

10 reference SCR recorded in a pack header, the corresponding pack must 
be input to the demultiplexer 52. Note that the STC 51 is initialized to the 
system clock reference SCR at the first pack in the system stream. The 
demultiplexer 52 then interprets the stream ID in the packet header, and 
transfers the payload data to the decoder buffer appropriate to each 

15 stream. The demultiplexer 52 also extracts the presentation time stamp 
PTS and decoding time stamp DTS. When the time indicated by the STC 
51 and the decoding time stamp DTS match, the video decoder 54 reads 
and decodes the picture data from the video buffer 53. If the decoded 
picture is a B picture, the video decoder 54 presents the picture. If the 

20 decoded picture is an I or P picture, the video decoder 54 temporarily 
stores the picture to the re-ordering buffer 55 before presenting the 
picture. 

The switch 56 corrects the difference between the decoding 
sequence and the presentation sequence as described above with 
25 reference to Fig. 3. That is, if a B picture is output from the video 
decoder 54, the switch 56 is set to pass the video decoder 54 output 
directly from the system decoder. If an I or P picture is output from the 
video decoder 54, the switch 56 is set to output the output from the re- 
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ordering buffer 55 from the system decoder. 

It should be noted that I pictures cannot be simultaneously 
decoded and presented because the picture sequence must be 
reordered to correct the differences between the decoding order and the 
5 display order. Even if no B pictures are present in the system stream, 
there is a delay of one picture, that is, one video frame period, between 
picture decoding and presentation. 

Similarly to the video decoder 54, the audio decoder 58 also reads 
and decodes one audio frame of data from the audio buffer 57 when the 
10 time indicated by the STC 51 and the presentation time stamp PTS 
match (note that there is no decoding time stamp DTS present in the 
audio stream). 

MPEG system stream multiplexing is described next with reference 
to Fig. 6. Fig. 6 (a) shows several video frames, Fig. 6 (b) represents the 

15 video buffer state, Fig. 6 (c) shows the MPEG system stream, and Fig. 6 
(d) shows the audio signal (audio data). The horizontal axis in each 
figure represents the time base, which is the same in each figure. The 
vertical axis in Fig. 6 (b) indicates how much data is stored in the video 
buffer at any given time; the solid line in Fig. 6 (b) indicates the change 

20 in the buffered data over time. The slope of the solid line corresponds to 
the video bit rate, and indicates that data is input to the buffer at a 
constant rate. The drop in buffered data at a regular period indicates that 
the data was decoded. The intersections between the diagonal dotted 
lines and the time base indicate the time at which video frame transfer to 

25 the video buffer starts. 

2. Problems with a conventional MPEG stream 

Digital cameras using a conventional MPEG stream as described 
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above are not believed to be presently available as commercial products 
because of the problems described below. For the convenience of the 
following description, however, it is herein assumed that this hypothetical 
digital camera exists. 

5 The relationship between the reproduction operation of an MPEG 

stream decoder in this hypothetical digital camera and the various time 
stamps (STC, PTS, DTS) is described first with reference to Figs. 17 and 
18. Note that the decoder is assumed to be comprised as shown in Fig. 5. 
Fig. 17 is used to describe the operation for reproducing data 

10 captured by the digital camera on a personal computer (PC). An 
exemplary screen presented on the PC display is shown in Fig. 17 (a). 
Photo #1 and photo #2 represent separate image files displayed on the 
screen in the form of icons. In a graphical user interface (GUI) such as 
Windows 95 (R), photos #1 and #2 may be presented as thumbnail 

15 sketches, for examples, which a user can click on using a mouse or 
other pointing device. The PC then presents the file content 
corresponding to the photograph that was clicked on by displaying the 
image on screen and outputting the audio from a speaker connected to 
the PC. Fig. 17 (b) shows the content displayed for photo #1 and photo 

20 #2 in this example. 

When a user clicks on photo #1 in Fig. 17 (a) in this example, still 
picture #1 is presented on screen, and audio #1 is output from the PC 
speaker, as shown in Fig. 17 (b). Likewise when the user clicks on photo 
#2, still picture #2 is presented on screen, and audio #2 is output from 

25 the PC speaker. 

The relationship between decoder operation in this hypothetical 
digital camera and the various time stamps when photo #1 is reproduced 
is shown in Fig. 18 and described below. 
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The video output, still picture #1, and audio output, audio #1, that 
are output for photo #1 are shown in Figs. 18(a) and 18(b). Figs. 18(c) 
and 18(d) show the change in the data stored to the video buffer 53 and 
audio buffer 57 as still picture #1 and audio #1 are decoded and output. 
5 Fig. 18(e) shows the pack sequence and time stamps (SCR, PTS, DTS) 
stored in each pack when photo #1 is stored to disc as stream #1, which 
is an MPEG stream in this example. 

It should be noted that while not shown in the figure, the DTS and 
PTS are stored in the packet header of each packet as described above. 
10 It will also be obvious to one with ordinary skill in the related art that 
while only four video packs and two audio packs are shown for simplicity, 
there are actually more than 100 audio packs and video packs each 
because each pack is a maximum 2 KB. 

The reproduction operation of this hypothetical digital camera 
15 starts by sending the packs contained in stream #1 shown in Fig. 18(e) 
to the demultiplexer 52. 

As shown in Fig. 18(e), stream #1 is multiplexed with the packs in 
the following sequence, starting from the beginning of the stream: video 
pack V1, video pack V2, audio pack A1, video pack V3, video pack V4, 
20 audio pack A2. The pack header of each pack contains a system clock 
reference SCR, which indicates the timing at which that pack is input to 
the demultiplexer 52. In the example shown in Fig. 18, time t1 is stored 
to system clock reference SCR #1 of video pack V1, time t2 is stored to 
SCR #2 of video pack V2, time t3 is stored to SCR #3 of audio pack A1, 
25 time t4 is stored to SCR #4 of video pack V3, time t5 is stored to SCR #5 
of video pack V4, and time t6 is stored to SCR #6 of audio pack A2. 

The PTS and DTS are also written to the first pack of each picture. 
Time t7 is thus written to PTS #1 of video pack V1, and time t6 is written 
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to DTS #1. Note that the PTS and DTS are the same for every video 
pack in a picture, and are therefore not written to any but the first video 
pack. 

The PTS is written to every audio pack. Therefore, time t7 is 
5 written to PTS #1 for audio pack A1, and time t9 is written to PTS #2 for 
audio pack A2. Note, further, that the PTS is written and the DTS is 
omitted in audio packs because the PTS and DTS are the same in an 
audio pack. The STC is reset at time t1, the value of SCR #1 in video 
pack V1, that is, the first pack in stream #1, and each pack in the stream 

10 #1 is then input to the demultiplexer 52 at the indicated by the SCR value 
in the pack header. 

Therefore, as shown in Fig. 18(e), video pack V1 is input to the 
demultiplexer 52 first at time t1, then video pack V2 is input at time t2, 
audio pack A1 is input at time t3, video pack V3 is input at time t4, video 

15 pack V4 is input at time t5, and audio pack A2 is input at time t8. Video 
packs input to the demultiplexer 52 are then output to the video buffer 53, 
and audio packs are output to the audio buffer 57. 

The second part of the reproduction operation of this hypothetical 
digital camera described below is the data decoding and output 

20 operation of the video packs output to the video buffer 53. 

As shown in Fig. 18(c), while there is an ignorable delay between 
the video packs output from the demultiplexer 52, the video packs are 
accumulated to the video buffer 53 at the system clock reference SCR 
timing, that is, at time t1, t2, t4, and t5. Still picture #1 comprises video 

25 packs V1 to V4. As a result, all video packs constituting still picture #1 
have been stored to the video buffer 53 once video pack V4 has been 
stored to the video buffer 53. As shown in Fig. 18(e), the decoding time 
stamp DTS of still picture #1 comprising video packs V1 to V4 is time t6. 
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The data accumulated to the video buffer 53 is therefore decoded by 
video decoder 54 at time t6, and the data is cleared from the video buffer, 
thereby increasing the available buffer capacity. 

The decoded video pack data of still picture #1 is an I picture. The 
5 decoded I picture is stored to re-ordering buffer 55, and is output from 
the decoder at PTS time t7. 

Note that the end presentation time for still picture #1 is not 
defined by an MPEG stream time stamp. As a result, presentation 
typically ends when reproduction of the next MPEG stream begins, or 
10 when video output is terminated by a control command sent to the 
decoder from another application or device. The example shown in Fig. 
18 therefore shows presentation of still picture #1 continuing even after 
time t10, the time at which audio output ends. 

The third part of the reproduction operation of this hypothetical 
15 digital camera described below is the relationship between the time 
stamps and the operation whereby audio pack data output to the audio 
buffer 57 is decoded and output. 

As shown in Fig. 18 (d), the audio packs output from the 
demultiplexer 52 are stored to the audio buffer 57 at time t3 and t8, thus 
20 increasing the amount of data stored to the audio buffer 57. Unlike the 
video data, the PTS and DTS are the same in the audio data. As a result, 
audio data is output at the same time the audio decoder 58 [57, sic, and 
below] decodes the audio pack data. More specifically, the audio pack 
A1 data stored to audio buffer 57 is decoded by audio decoder 58 at the 
25 presentation time stamp PTS, i.e., time t7, and audio output begins. The 
audio pack A2 data stored to the audio buffer 57 at time t8 is then 
decoded and output at the PTS, that is, time t9, by audio decoder 58. 

The time that data can be stored to each decoder buffer is also 
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limited in the MPEG system. This limit is 1 sec. in the case of moving 
picture data. This means that the maximum difference between the 
transfer times of simultaneously output audio and video data, that is, the 
maximum SCR difference, is 1 second. However, a delay equal to the 
5 time required to reorder the video data may also occur. 

3. MPEG stream problems 

Through years of research and development, the inventors have 
identified and organized problems presented by the conventional MPEG 

10 stream described above with respect to using the MPEG stream in a 
digital still picture camera. 

As noted above, the MPEG system stream contains video data and 
the audio data presented with that video data multiplexed into a single 
system stream. Editing this system stream to change the audio 

15 presented with a particular video image is therefore difficult once the 
audio and video streams have been multiplexed into a single system 
stream. This means that when a digital camera uses an MPEG stream to 
encode and store a still picture and the audio recorded when that picture 
was taken to a recording medium, it is difficult to later edit the audio to 

20 replace the audio recorded when the picture was taken with a different 
audio signal. 

Referring to the example shown in Fig. 17, when photo #1 is 
captured by a digital still picture camera, photo #1 is recorded by the 
camera to a disc or other recording medium as an MPEG stream 
25 multiplexing still picture #1, that is, the still picture data, and audio #1, 
that is, the audio data captured at the same time. The resulting MPEG 
stream thus comprises multiplexed video packs and audio packs as 
shown in Fig. 18(e). As a result, after the user takes a picture, it is 



WO 99/53694 



PCT/JP99/01811 



21 

difficult to change the audio data of photo #1 from audio #1 to a different 
audio signal. 

Though difficult, the following three methods of editing the audio 
data after recording are conceivable. 
5 (1) Generate a plurality of MPEG streams, each multiplexing the video 
data (the photographed still picture data) with one of a plurality of audio 
data streams that might be used with the video data, and record all of 
these plural MPEG streams to the recording medium. This method 
means that in the example shown in Fig. 18, a number of other streams, 

10 each containing the same video packs but a different selection of audio 
packs, is recorded in addition to stream #1 shown in Fig. 18(e). There is 
a limit to the number of MPEG streams that can be recorded, however, 
because the storage capacity of the recording medium is also limited. 
More particularly, however, it is not practically possible for the user to 

15 record at the time the picture is taken all audio data that might be 
desirably combined with the still picture. 

(2) Decode the MPEG stream during editing to separate the still 
picture data from the audio data, and then re-encode the system stream 
with the still picture data and the new audio data. This method, however, 

20 requires system stream decoding and encoding each time the audio is 
edited, thus increasing the required editing time. The entire system 
stream is also stored as decoded (uncompressed) data, thus requiring a 
large amount of memory in the digital camera. 

(3) Record the video stream and audio stream as two separate 
25 (unmultiplexed) streams, and determine what audio stream to use with a 

particular video stream at the time of reproduction. This method makes it 
possible to add audio data after recording a still picture to the recording 
medium, and then reproduce the added audio data when reproducing the 
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still picture. 

The inventors of the present invention have used the above 
method (3). More specifically, the present invention provides a method 
5 and apparatus for reproducing two MPEG streams stored separately on 
disc as though they are a single MPEG stream using a conventional 
MPEG decoder. 

MPEG stream according to the present invention 

10 To achieve the present invention by using a conventional decoder 

to reproduce two separate MPEG streams, one for still picture data and 
one for audio data, as noted above, it is necessary to drive the decoder 
to process the two MPEG streams as a single system stream. 

The first problem to be overcome in processing two MPEG streams 

15 as though they are a single system stream is that a discrete time stamp 
is assigned to the two streams. When the two streams are processed 
continuously as one stream, contradictions such as a discontinuity 
between the time stamps assigned to the two streams can occur. 

While the time stamps in the MPEG stream are multiplexed into 

20 the data, the initial time stamp value (the first system clock reference 
SCR in the stream) in a normal MPEG stream is not defined by the 
MPEG standard. In practice, therefore, the encoder assigns a specific 
value. 

It will therefore be obvious that there is no continuity or correlation 
25 between the time stamps assigned to MPEG streams generated by 
different encoders. Assume, for example, that encoder A generates an 
MPEG stream A encoded with an initial SCR of 0, and an encoder B 
generates an MPEG stream B encoded with an initial SCR of 1000. The 
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SCR of the last pack in stream A is 27000000 (27 MHz). Here, (27 MHz) 
indicates that the number preceding (27 MHz) is a counted value using 
27 MHz clock. Streams A and B are to be continuously processed by the 
decoder as a single stream. A discontinuity occurs in the SCR in this 
5 case between the end of stream A and the beginning of stream B, and 
there is a strong possibility that the decoder hangs up or other error 
occurs. 

To resolve this problem, a recording apparatus according to the 
present invention limits the values of the time stamps (SCR, PTS, DTS) 
10 in the system streams that are generated and recorded to disc. 

The MPEG stream time code limits imposed by the present 
invention are described next below. 

Fig. 11 is referred to below to describe the time stamps used for 
the still picture data system stream ST1 and the audio data system 
15 stream ST2 in this preferred embodiment of the present invention. 

Fig. 11(a) shows the structure of the system stream for still picture 
data, referred to as a video object (VOB). System clock reference SCR1 
is written to the pack header of the first pack in the VOB, and PTS1 and 
DTS1 are written to the packet header of the first VOB. SCR2 is written 
20 to the pack header of the last pack. 

Fig. 11(b) shows the VOB for the audio data system stream ST2. 
SCR3 is written to the pack header of the first pack in this VOB, and 
PTS3 is written to the packet header. 

Fig. 1 1 (c) shows the sequence in which the still picture data and 
25 audio data system streams are input continuously to the decoder during 
reproduction. 

In order to drive the decoder to process the still picture data 
system stream ST1 and audio data system stream ST2 as a single 
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system stream, the values assigned to the system clock reference SCR2 
in the last pack of the still picture data system stream ST1, and the 
system clock reference SCR3 in the first pack of the audio data system 
stream ST2, are limited as defined by equation (1) below in the present 
5 invention. 

SCR2 + Tp<SCR3 (1) 
where Tp is the time required to transfer one pack to the decoder. More 
specifically, Tp is a time period from the moment when one pack starts to 
enter the demultiplexer 52 until said one pack completely enters the 

10 demultiplexer 52. Since the pack merely passes through the 
demultiplexer 52, it is also possible to say that Tp is a time period from 
the moment when one pack starts to enter the buffer 53 (or 57) unit said 
one pack completely enters the buffer 53 (or 57). 

It should be noted that equation (1) limits the smallest value that 

15 can be assigned to SCR3. SCR3 is often set to zero (0) in a conventional 
MPEG stream. A recording apparatus according to the present invention, 
however, calculates the SCR3 value from equation (1). 

By thus calculating the value of SCR3, SCR2 is prevented from 
being greater than SCR3, and the SCR values in each pack of the still 

20 picture data system stream ST1 and audio data system stream ST2 are 
assured of being in a rising numerical sequence from one system stream 
to the next. 

Equation (1) also assures that the difference between SCR2 and 
SCR3 is at least Tp. This prevents the transfer timing of the first pack in 
25 the audio data system stream ST2 from conflicting with the transfer of 
the last pack in the still picture data system stream ST1, that is, 
transferring the first pack in the audio data system stream ST2 will not 
start while the last pack in the still picture data system stream ST1 is still 
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being transferred. 

It should be further noted that if the system stream transfer rate is 
8 Mbps, the pack transfer time TP will be 55296 (27 MHz); if 10.08 Mbps, 
the pack transfer time Tp will be 43885 (27 MHz). 
5 A decoder according to the present invention is further comprised 

to accept input of the audio data system stream ST2 following a still 
picture data system stream ST1 without first resetting the STC after input 
thereto of a still picture data MPEG stream has been completed. This is 
because it would be meaningless to limit the value of the SCR in the first 
10 audio stream pack if the decoder resets the STC after still picture data 
input, as it conventionally does after each system stream. 

By thus driving the decoder to process supplied system streams 
based on time stamp values calculated as described above, the decoder 
can handle separate still picture data and audio data system streams as 
15 a single MPEG stream. That is, a still picture data stream and a 
separately recorded audio data stream can be reproduced as though 
they are a single system stream. 

The presentation time stamps PTS1 and PTS3 are also set to the 
same specified value as shown in equation (2) below. 
20 PTS1 = PTS3 = specified value (2) 

This assures that both audio and still picture data output begin at 
the same time. 

In this exemplary embodiment of the present invention, this 
specified value is 
25 90000 (90 kHz) + Tv 

where Tv is the video frame period, and (90 kHz) indicates that the 
number preceding (90 kHz) is a counted value using 90 kHz clock. In an 
NTSC signal, Tv is therefore 3003; in a PAL signal, it is 3600. 
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The time stamps shown in Fig. 11 are described more specifically 
below with reference to a case in which still picture data and audio 
output begin simultaneously at approximately 1 second (90000 (90 kHz) 
+ Tv) after data reading based on the time stamps calculated from the 
5 above equations (1) and (2). 

The time stamp for the still picture data VOB is described first. 

(1) The system clock reference SCR (SCR1) for the first pack in 
the still picture data VOB is 0 (27 MHz). 

(2) The decoding time stamp DTS (DTS1) for the first pack in 
10 the still picture data VOB is 90000 (90 kHz). Note that a still picture data 

VOB contains only one still picture. 

(3) The presentation time stamp PTS (PTS1 ) for the first pack in 
the still picture data VOB is 93003 (90 kHz). Note that PTS1 = 93003 is 
for an NTSC video signal; for a PAL video signal, PTS1 = 93600. This is 

15 because the video frame period (Tv) in an NTSC signal is 3003, and is 
3600 in a PAL signal. Note, further, that because a still picture data VOB 
contains only one still picture, all packs are output simultaneously at the 
time indicated by PTS1. 

(4) The SCR (SCR2) of the last pack in the still picture data 
20 VOB is set to a value 27000000 (27 MHz) minus the transfer time of one 

pack (Tp). 

The value 27000000 (27 MHz) is called a base value below. 

This base value is set so that the longest delay between when 
moving picture data is input to the decoder buffer and when it is decoded 
25 is 1 second (27000000 (27 MHz)). 

More specifically, if the maximum moving picture data storage time 
is applied to still picture data, all packs in the still picture data VOB must 
be transferred to the decoder within 1 second (27000000 (27 MHz)). If 
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SCR1 for the first pack is 0, the data stored in the first pack will be 
decoded within 1 second (27000000 (27 MHz)) after it is transferred to 
the decoder, and the SCR (SCR2) of the last pack in the same still 
picture data VOB is therefore pack transfer time Tp less than 27000000 
5 (27 MHz). 

The PTS value and this base value are defined as described 
above to ensure encoder compatibility. In other words, if the still picture 
data system stream ST1 and audio data system stream ST2 are encoded 
using the values derived from equations (1) and (2), the above specified 
10 PTS value, and the above base value, the present invention can be 
applied regardless of what encoder generates the system streams. 

It should be noted that the base value is defined in this preferred 
embodiment as 27000000 (27 MHz). The following equations (3) and (4) 
can therefore be derived where this base value is MaxT. 
15 SCR2 + Tp < MaxT (3) 

SCR3 = MaxT (4) 

The time stamps of the audio data VOB are described next. 

(1) The system clock reference SCR (SCR3) of the first audio 
pack is 27000000 (27 MHz). Using this value, the audio pack will be 
input to the decoder continuously to the preceding still picture data VOB 
at the shortest time satisfying equation (1). In addition, because the still 
picture data PTS1 is 93003 (90 kHz), the SCR must be set to a smaller 
value in order to simultaneously output the audio. 

(2) The presentation time stamp PTS (PTS3) of the first audio 
frame in the VOB is 93003 (90 kHz). As noted above, this is for an NTSC 
video signal; if PAL video, PTS3 is 93600. 

It will also be obvious to one with ordinary skill in the related art 
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that insofar as the still picture data VOB and audio data VOB are 
encoded to satisfy equations (1) and (2), the present invention shall not 
be limited to the conditions (values) described above. 

For example, if the video is an NTSC signal and the first SCR is 
5 27000000 (27 MHz) rather than 0, the following values apply. 
SCR1 = 27000000 (= 1 sec) 
SCR2 < 53944704 (= SCR3 - Tp) 
SCR3 = 54000000 (= SCR1 + 1 sec) 
PTS1 = PTS3 = 183003 (= DTS1 + 3003) 
10 DTS1 = 180000 (= 1 sec) 

If the video is an NTSC signal, the first SCR is 0, and PTS is 1 
second, the following values apply. 
SCR1 =0 

15 SCR2 £ 26043804 (= SCR3 - Tp) 

SCR3 = 26099100 (= 1 sec - 3003 x 300) 
PTS1 = PTS3 = 90000 (= 1 sec) 
DTS1 = 86997 (= PTS1 - 3003) 

20 If the video is a PAL signal and the first SCR is 27000000 (27 

MHz), the following values apply. 

SCR1 = 27000000 (= 1 sec) 

SCR2 < 53944704 (= SCR3 - Tp) 

SCR3 = 54000000 (= SCR1 + 1 sec) 
25 PTS1 = PTS3 = 183600 (= DTS1 + 3600) 

DTS1 = 180000 (= 1 sec) 

If the video is a PAL signal, the first SCR is 0, and PTS is 1 
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second, the following values apply. 
SCR1 = 0 

SCR2 £ 25864704 (= SCR3 - Tp) 
SCR3 = 25920000 (= 1 sec - 3600 x 300) 
5 PTS1 = PTS3 = 90000 (= 1 sec) 

DTS1 = 86400 (= PTS1 - 3600) 

If the transfer rate is 10.08 Mbps, and the video is an NTSC signal, 
the following values apply. 
10 SCR1=0 

SCR2 < 26956115 (= SCR3 - Tp (=43885)) 
SCR3 = 27000000 (= 1 sec) 
PTS1 = PTS3 = 93003 (= DTS1 + 3003) 
DTS1 = 90000 (= 1 sec) 

15 

If the transfer rate is 10.08 Mbps, and the video is a PAL signal, 
the following values apply. 
SCR1 = 0 

SCR2 < 269561 1 5 (= SCR3 - Tp (= 43885)) 
20 SCR3 = 27000000 (= 1 sec) 

PTS1 = PTS3 = 93600 (= DTS1 + 3600) 
DTS1 = 90000 (= 1 sec) 

An operation whereby an MPEG stream having time stamps 
25 defined as described above is processed by an exemplary decoder is 
described next below with reference to Fig. 19 and Fig. 20. Note that this 
decoder is comprised as shown in Fig. 5. 

Like Fig. 18, Fig. 19 shows the relationship between decoder 
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operation in digital still camera according to the present invention and 
the various time stamps when photo #1 is reproduced. 

The video output, still picture #1, and audio output, audio #1, that 
are output for photo #1 are shown in Figs. 19(a) and 19(b). Figs. 19(c) 

5 and 19(d) show the change in the data stored to the video buffer 53 and 
audio buffer 57 as still picture #1 and audio #1 are decoded and output. 
Fig. 19(e) shows the pack sequence and the time stamps (SCR, PTS, 
DTS) written to each pack of the video stream #1 and audio stream #1, 
both of which are MPEG streams, when photo #1 is stored to disc as two 

10 streams #1 and #2. 

It should be noted that the packet structure and further description 
thereof are omitted here as in Fig. 18. 

The first part of the description of the reproduction operation of a 
digital still camera according to the present invention starts with the 

15 operation for transferring the packs of streams #1 and #2 shown in Fig. 
19(e) to the demultiplexer 52. 

As shown in Fig. 19(e), stream #1 comprises video pack V1, video 
pack V2, video pack V3, and video pack V4 multiplexed in sequence 
from the beginning of the stream. Stream #2 likewise comprises audio 

20 pack A1 and audio pack A2 multiplexed in sequence starting from the 
beginning of the stream. It is important to note here that stream #1 
comprises only video packs, and stream #2 comprises only audio packs. 

The pack header of each pack also contains a system clock 
reference SCR. As shown in Fig. 19(e), SCR#1 of video pack V1 in 

25 stream #1 is time t1; SCR#2 of video pack V2 is time t2; SCR#3 of video 
pack V3 is time t3; and SCR#4 of video pack V4 is time t4. The 
presentation time stamp PTS and decoding time stamp DTS are also set 
in the first video pack in the video stream V1. PTS#1 in video pack V1 is 
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time t8, and DTS#1 is time t6. 

In this preferred embodiment as described above, the value of time 
H, that is, the value of SCR#1 in the first video pack V1, is 0. The value 
of SCR#4 in the last video pack V4 is likewise 27000000 (27 MHz) - Tp, 
5 where Tp is the pack transfer time described above and is 55296 (27 
MHz). Assuming that the video data is NTSC coded, time t8 of PTS#1 is 
93003 (90 kHz), and time t6 of DTS#1 is 90000 (90 kHz). 

The system clock reference SCR#5 of the first audio pack A1 in 
stream #2 is time t7, and SCR#6 of audio pack A2 is time t9. A 
10 presentation time stamp PTS is also set in audio packs A1 and A2. 
PTS#5 in audio pack A1 is time t8, and PTS#6 in audio pack A2 is time 
t10. 

In this preferred embodiment as described above, the value of time 

t7, that is, the value of SCR#5 in the first audio pack A1 , is 27000000 (27 
15 MHz). Time t8 of PTS#5 in audio pack A1 is the same as the video data 

PTS, that is, 93003 (90 kHz). 

The system time clock STC is reset to time t1, the value of SCR#1 

in the first video pack V1, and each pack in stream #1 is then input to the 

demultiplexer 52 at the time indicated by the SCR of each pack. 
20 That is, as shown in Fig. 19(e), the first video pack V1 is input to 

the demultiplexer 52 at time t1, video pack V2 is input at time t2, video 

pack V3 at time t3, and video pack V4 at time t4. 

The decoding process of a digital still camera according to the 

present invention differs from a conventional camera as described with 
25 reference to Fig. 18 in that the system time clock STC of the decoder is 

not reset after all of stream #1 is input, and the packs of stream #2 are 

input continuously to the demultiplexer 52 at the SCR timing written to 

each pack. 
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The first audio pack A1 in stream #2 is thus input to the 
demultiplexer 52 at time t7, and audio pack A2 is input at time t9. 

It is important to note here that the SCR#4 of the last video pack 
V4 and the SCR#5 of the first audio pack A1 are set to satisfy equation 
5 (1) above, which can thus be restated as follows. 

SCR#4 + Tp < SCR#5 (1) 

Continuity between the SCR values of stream #1 and stream #2 is 
thus assured, the interval therebetween is at least equal to the pack 
transfer time, and the decoder can thus continuously process two 
10 streams without hanging up. 

The demultiplexer 52 outputs video packs input thereto to the 
video buffer 53, and outputs audio packs input thereto to the audio buffer 
57. 

The second part of the reproduction operation of a digital camera 
15 according to the present invention described below is the data decoding 
and output operation of the video packs output to the video buffer 53. 

As shown in Fig. 19(c), while there is an ignorable delay between 
the video packs output from the demultiplexer 52, the video packs are 
accumulated to the video buffer 53 at the SCR timing, that is, at time t1, 
20 t2, t3, and t4. Still picture #1 comprises video packs V1 to V4. As a result, 
all video packs constituting still picture #1 have been stored to the video 
buffer 53 once video pack V4 has been stored to the video buffer 53. As 
shown in Fig. 19(e), the decoding time stamp DTS of still picture #1 
comprising video packs V1 to V4 is time t6. The data accumulated to the 
25 video buffer 53 is therefore decoded by video decoder 54 at time t6, and 
the data is cleared from the video buffer, thereby increasing the available 
buffer capacity. 

The decoded video pack data of still picture #1 is an I picture. The 
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decoded I picture is stored to re-ordering buffer 55, and is output from 
the decoder at PTS time t8. 

The third part of the reproduction operation of a digital camera 
according to the present invention described below is the relationship 
5 between the time stamps and the operation whereby audio pack data 
output to the audio buffer 57 is decoded and output. 

As shown in Fig. 19(d), the audio packs output from the 
demultiplexer 52 are stored to the audio buffer 57 at time t7 and t9, thus 
increasing the amount of data stored to the audio buffer 57. Unlike the 
10 video data, the PTS and DTS are the same in the audio data. As a result, 
audio data is output at the same time the audio decoder 58 [57, sic, and 
below] decodes the audio pack data. More specifically, the audio pack 
A1 data stored to audio buffer 57 is decoded by audio decoder 58 at the 
presentation time stamp PTS, i.e., time t8, and audio output begins. The 
15 audio pack A2 data stored to the audio buffer 57 at time t9 is then 
decoded and output at the PTS, that is, time t10, by audio decoder 58. 

It is important to note here that the PTS is the same in the still 
picture data stream #1 and the audio data stream #2. As a result, stream 
#1 and stream #2 are input to the decoder at different times, but are 
20 output at the same time, which is determined by the PTS. 

It will therefore be obvious that insofar as the time stamps are 
within the limits defined above, an MPEG stream comprising only still 
picture data, and an MPEG stream comprising only audio data, can be 
processed continuously, one following the other, by a decoder, with the 
25 audio and video presentation occurring simultaneously. 

It will also be obvious that by recording the still picture data MPEG 
stream and audio data MPEG stream separately to disk, the audio to be 
reproduced with a particular still picture can be freely and easily changed 
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and edited after the still picture data is captured and recorded. 

Assume, for example, that still picture #1 and audio #1 described 
above with reference to Fig. 19 are the data recorded to disk when the 
image was photographed. To later change the audio that is to be output 

5 simultaneously with the still picture #1, it is only necessary to record an 
MPEG stream encoded with time stamps derived from equations (1) and 
(2). An example of this new audio #2 additionally recorded as MPEG 
stream #3 is shown in Fig. 20. 

Though not shown in the figures, management information 

10 indicating what audio data MPEG stream is to be reproduced 
simultaneously with the MPEG stream for still picture #1 is also recorded 
to disk. This management information can then be updated so that the 
MPEG stream for audio #2 is reproduced simultaneously with the MPEG 
stream for still picture #1 instead of the MPEG stream for audio #1. 

15 

DVD-RAM description 

DVD-RAM is described next below as a recording medium and 
recording format suitable for recording MPEG streams as described 
above. 

20 Advances in high density recording technologies for rewritable 

optical discs have expanded their range of applications from computer 
data and music to image data. A typical conventional optical disc has a 
guide channel of either lands or grooves formed on the signal recording 
surface of the disc. This has meant that signals are recorded using only 

25 the lands or the grooves. The development of a land and groove 
recording method, however, has enabled signals to be recorded to both 
lands and grooves, thus approximately doubling the recording density of 
the disc. 
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Constant linear velocity (CLV) control is also an effective means of 
improving recording density, and the development of a zoned CLV 
control method has made it easier to implement CLV control. 

How to utilize these high capacity optical discs to record AV data, 
5 including video and other image data, and achieve new products with 
features and functions far surpassing those of conventional AV products 
is a major concern for the industry. 

It is also thought that the availability of large capacity, rewritable 
optical disc media will result in the primary medium for recording and 
10 reproducing AV materials changing from conventional tape media to 
optical disc media. The change from tape to disc media will also have 
wide-ranging effects on the functions and performance of AV equipment. 

One of the greatest benefits to be gained from a switch from tape 
to disc media is a significant increase in random access performance. 
15 While it is possible to randomly access tape media, several minutes may 
be required to access a particular part of the tape due to the need to 
fast-forward and/or rewind in a linear fashion. When compared with the 
seek time of optical disc media, which is typically on the order of several 
10 milliseconds, there is an obvious and significant improvement in 
20 random access performance achieved by a switch to disc media. Tape is 
therefore obviously unsuitable as a random access medium. 

Random access also means that distributed (that is, non- 
contiguous) recording of AV material is possible with optical disc media, 
though impossible with conventional tape media. 

25 

Lo gic structure of DVD-RAM media 

The logic structure of DVD-RAM media is described next below 
with reference to Fig. 8. Fig. 8(a) shows the directory file and the 
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organization of the disc recording area. 

The recording area of the optical disc is arranged into a plurality of 
physical sectors in a spiral pattern from the inside circumference to the 
outside circumference of the disc. 
5 The physical sectors of the disc are further allocated to one of 

three areas from the inside circumference to the outside circumference 
of the disc. A lead-in area is located at the inside circumference area of 
the disc. A lead-out area is located at the outside circumference area of 
the disc. A data area is provided between the lead-in and lead-out areas. 
10 Each sector also has an address segment and a data segment. 

The address segment stores address information specifying the location 
of that sector on the optical disc, and an identifier identifying whether the 
sector is in the lead-in, data, or lead-out area. Digital data is stored to 
the data segment. 

15 The data segment of sectors in the lead-in area contains 

information for initializing the device used to reproduce data from the 
disc (reproduction device). This information typically includes a reference 
signal required for servo stabilization, and an ID signal for differentiating 
one disc from another. 

20 The data segment of sectors in the data area records the digital 

data constituting the application [? or user data ?] stored to the disc. 

The lead-out area identifies the end of the recording area for the 
reproduction device. 

Management information for managing disc content and 

25 constituting the file system is recorded to the beginning of the data area. 
This management information is the volume information. The file system 
is a table of contents for grouping a plurality of disc sectors into groups, 
and managing these disc sector groups. A DVD-RAM medium according 
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to the present invention preferably uses the file system defined in ISO 
13346. 

An optical disc according to this preferred embodiment has a file 
directory structured as shown in Fig. 8 (a). 
5 All data handled by a DVD recording apparatus belongs to the 

VIDEO_RT directory directly under the ROOT directory. 

There are two basic file types handled by a DVD recording 
apparatus: a single management information file, and at least one, 
though typically plural, AV files. 

10 

Manag e ment information file 

The content of the management information file is described next 
with reference to Fig. 9 (a). 

The management information file contains a VOB (video object) 
15 table and a PGC (program chain) table. A VOB is an MPEG program 
stream. The program chain defines the reproduction order of individual 
cells. A cell is a logic unit for reproduction, and corresponds to a 
particular part or all of a VOB. In other words, a VOB is a meaningful unit 
in an MPEG stream, and the PGC is unit reproduced by an MPEG stream 
20 reproducing apparatus. 

The VOB table records the number of VOBs (Number_of_VOBs), 
and certain information about each VOB. This VOB information includes: 
the name of the corresponding AV file (AV_File_Name); the VOB 
identifier (VOBJD); the start address in the AV file 
25 (VOB__Start_Address); the end start address in the AV file 
(VOB_End_Address); the VOB playback time (VOB_Playback_Time); 
and stream attributes (VOB_Attribute). 

The PGC table records the number of PGCs (Number_of_PGCs) 
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[Number_of_VOBs, sic], and certain information about each PGC. This 
PGC information includes: the number of cells in the PGC 
(Number_of_Ceils), and certain cell information. 

This cell information includes: the corresponding VOB_ID; the cell 
5 start time in the VOB (Cell_Start_Time); the cell playback time in the 
VOB (CelLPIayback_Time); the address at which cell playback starts in 
the VOB (Cell_Start_Address) and the address at which cell playback 
ends (Cell_End_Address); an audio flag indicating that there is audio to 
be reproduced simultaneously with the still picture data (Audio_Flag). 
10 When Audio_Flag is set to 1, cell extension information exists for the 
related audio data, that is, the VOBJD, CelLStart_Time, 
CelLPIaybackJTime, Cell_Start_Address, and Ce!l_End_Address. When 
Audio_Flag is reset to 0, cell extension information for the related audio 
data does not exist. 

15 It is important here to note the audio flag (Audio_Flag), which is 

used to declare whether or not there is audio data to be output 
simultaneously with the still picture. 

AV f ile 

20 The AV file structure is described next with reference to Fig. 9 (b). 

An AV file has at least one, and typically plural, VOBs. VOBs are 
recorded continuously to disc, and VOBs associated with a particular AV 
file are arranged contiguously on disc. VOBs in an AV file are managed 
using the VOB info in the management information file. When the DVD 

25 reproducing apparatus first accesses the management information file, it 
reads the VOB start and end addresses, and is thus able to access the 
VOB. 

The logical reproduction unit of the VOB is the cell. A cell is a part 
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of the VOB to be reproduced; it may correspond to the entire VOB, and 
can be set as desired by the user. These cells make editing simple 
without actually manipulating the AV data. As with a VOB, cell access is 
managed using the cell information in the management information file. A 
5 DVD reproducing apparatus thus accesses the management information 
file to read the cell start and end address information in order to access 
a cell. 

Cell address information is referenced to the VOB, and VOB 
address information is referenced to the AV file. As a result, the DVD 
10 reproducing apparatus accesses a cell by adding the cell address 
information to the VOB address information to calculate the address in 
the AV file, enabling the DVD reproducing apparatus to access the AV 
file. 

15 Links between still picture data and audio data 

How a still picture and audio are synchronously reproduced is 
described next with reference to Fig. 10. 

Fig. 10 (a) shows part of the management information file 
described above. As shown in Fig. 10 (a), cell information for a still 
20 picture contains access information (VOB_ID, Cell_Start_Time, 
Cell_Playback_Time, Cell_Start_Address, and Cell_End_Address) for the 
still picture data and the corresponding audio data. 

The audio flag (Audio_Flag) declares whether there is audio data 
to be reproduced with the still picture data. Therefore, when the audio 
25 flag indicates that there is audio data to be reproduced with the still 
picture data, the cell also contains access information for the audio data 
VOB. 

A relationship between still picture data and audio data is thus 
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established by setting the audio flag (Audio_Flag) and declaring the VOB 
information for the audio data. 

Fig. 10 (b) shows an AV file for still picture data and audio data. 
Data stored in a VOB is either still picture data or audio data. There is 

5 no VOB that contains both still picture data and audio data in a 
multiplexed manner. Unlike moving picture data VOBs, in the present 
invention, still picture data VOBs comprise only a single I picture video 
frame, an intraframe compressed video image, and audio data VOBs 
contain only audio data. The still picture data and audio data playback 

10 control information is generated by referring to the cell information for 
the still picture data VOBs and audio data VOBs, and defining the still 
picture cell playback order from the PGC. 

It is therefore possible to freely combine still picture data and 
audio data streams by defining the playback order of referenced cells for 

15 separately recorded still picture data and audio data. 

It should be noted that while this preferred embodiment has been 
described as having two VOBs for one MPEG stream; one for the video 
data and the other for the audio data, the data structure is not limited as 
such as long as the audio data and the video data can be separated, and 

20 the separated audio data can be replaced with another audio data. 

For example, the video data (video stream part) and the audio data 
(audio stream part) can be incorporated in a single VOB. Such an 
example is shown in Fig. 10(c). In this case, the video data of the still 
picture is stored in the video part, which is located in the leading half 

25 portion of the VOB, and the audio data is stored in the audio part, which 
is located in the trailing half portion of the VOB. Fig. 10(c) shows 
RTR_STO.VRO file, such as shown in Fig. 8(b). 

It is noted that the first system stream ST1 shown in Fig. 11 and 
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the video part shown in Fig. 10(c) are generally referred to as a video 
part stream. Similarly, the second system stream ST2 shown in Fig. 12 
and the audio part shown in Fig. 10(c) are generally referred to as an 
audio part stream. 

The file structure may also be as shown in Fig. 8(b). In this case, 
the VIDEO_RT directory corresponds to the DVD_RTR directory, and 
RTR.IFO, RTR_STO.VRO, RTR_STA.VRO, and RTR_MOV.VRO files are 
under the DVD_RTR directory. 

The RTR.IFO file corresponds to the management information file. 
The RTR_STO.VRO and RTR_STA.VRO files are related to the still 
picture data. The RTR_STO.VRO file records the still picture data (video 
part) and the audio data (audio part) simultaneously recorded with the 
still picture data. The RTR_STA.VRO file records only the audio data 
(audio part) edited after initial recording. Audio data in the 
RTR_STA.VRO file is recorded with a relationship to still picture data 
recorded in the RTR_STO.VRO file. Moving picture data is recorded 
separately from still picture data in the RTR_MOV.VRO file. 

Still picture data VOB and audio data VOB 

As described above with reference to Fig. 11, the time stamps for 
the still picture data VOBs and audio data VOBs are as shown below. 

SCR1 = 0 

SCR2 <, 27000000 (27 MHz) - Tp 
SCR3 = 27000000 (27 MHz) 
Tp = 55296 (27 MHz) 
PTS1 = PTS3 = 90000 + Tv 
DTS1 = 90000 
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Description of a DVD recording apparatus 

A DVD recording apparatus is described next. 

Fig. 1 is a block diagram of a DVD recording apparatus. Shown in 
Fig. 11 are: an optical pickup 11 for reading data from and writing data to 
5 a disc; an error correction code (ECC) processor 12; a track buffer 13; a 
switch 14 for changing input to and output from the track buffer 13; an 
encoder 15; and a decoder 16. Reference numeral 17 is an enlarged 
view of the disc surface. 

As shown in enlarged view 17, the smallest recording unit for data 
10 recorded to a DVD-RAM disc is the sector, which holds 2KB. One ECC 
block contains 16 sectors, and is the unit processed by the ECC 
processor 12 for error correction. 

Using a track buffer 13 enables AV data recorded at non- 
contiguous locations on the disc to be supplied to the decoder without an 
15 interruption in the data stream. This is described below with reference to 
Fig. 2. 

Fig. 2 (a) shows the address space on the disc. When the AV data 
is recorded to two separate contiguous regions, [a1, a2] and [a3, a4] as 
shown in Fig. 2 (a), continuous presentation of the AV data can be 
20 maintained while seeking address a3 from a2 by supplying data 
accumulated to the track buffer to the decoder. This is illustrated in Fig. 
2(b). 

When reading AV data from address a1 starts at time t1 f the data 
is input to the track buffer with output from the track buffer beginning at 
25 the same time. There is, however, a difference of (Va - Vb) between the 
track buffer input rate Va and the output rate Vb from the track buffer. 
This means that data gradually accumulates in the track buffer at the 
rate (Va - Vb). This continues to address a2 at time t2. If B(t2) is the 
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amount of data accumulated in the track buffer at time t2, the data B(t2) 
stored in the track buffer can be supplied to the decoder until reading 
begins again from address a3 at time t3. 

More specifically, if the amount of data read from [a1, a2] before 
5 the seek operation begins is at least equal to a predetermined amount, 
i.e., at least equal to the amount of data supplied to the decoder during 
the seek operation, AV data can be supplied without interruption to the 
decoder. 

It should be noted that the still picture data system stream ST1 

10 and audio data system stream ST2 processed contiguously by the 
decoder in the present invention is not necessarily contiguously recorded 
to the disc. In the case shown in Fig. 20, for example, there are two 
audio data system streams, streams #2 and #3, that can be processed 
continuously with the still picture data system stream ST1 #1 by the 

15 decoder. It will be obvious that only one of these audio data system 
streams can be recorded contiguously to the still picture data system 
stream ST1 on disc, and the other audio data system stream ST2 must 
be recorded at an address that is non-contiguous to stream #1. 

A DVD recording apparatus comprised as described above, 

20 however, can still supply two non-contiguous streams to the decoder with 
no interruption between the streams. The decoder can therefore 
continuously process two streams, and the operation described with 
reference to Fig. 19 can be assured. 

It should be further noted that while the above example has 

25 addressed reading, that is, reproducing data from DVD-RAM, the same 
principle applies to writing, that is, recording data to DVD-RAM. 

More specifically, insofar as a predetermined amount of data is 
recorded contiguously to DVD-RAM, continuous reproduction and 
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recording are possible even if the AV data is recorded non-contiguously. 
Fig. 12 is a block diagram of a DVD recording apparatus. 
Shown in Fig. 12 are: a user interface 1201 for presenting 
messages to the user and receiving commands from the user; a system 

5 controller 1202 for overall system control and management; an input 
section 1203, typically a camera and microphone; an encoder 1204, 
including a video encoder, audio encoder, and system stream encoder; 
an output section 1205, typically comprising a monitor and speaker; a 
decoder 1206, including a system stream decoder, audio decoder, and 

10 video decoder; a track buffer 1207; and a drive 1208. 

The recording operation of a DVD recording apparatus thus 
comprised is described next below with reference to the flow charts in 
Fig. 13, Fig. 14, and Fig. 15. 

Operation starts when a user command is received by the user 

15 interface 1201. The user interface 1201 passes the user command to the 
system controller 1202. The system controller 1202 interprets the user 
command, and appropriately instructs the various modules to perform the 
required processes. Assuming that the user request is to capture a still 
picture and record the accompanying audio, the system controller 1202 

20 instructs the encoder 1204 to encode one video frame and encode the 
audio. 

The encoder 1204 thus video encodes and then system encodes 
the one video frame sent from the input section 1203, thus generating a 
still picture data VOB. The encoder 1204 then sends this still picture data 
25 VOB to the track buffer 1207. (S1301) 

This still picture data VOB encoding process is described more 
specifically below with reference to Fig. 14. 

The encoder 1204 first initializes the various time stamps. In this 
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example, it resets the system clock reference SCR to 0, and initializes 
the PTS and DTS to 93003 (90 kHz) and 90000 (90 kHz), respectively. 
(S1401) Note that if PAL video is used, the PTS is initialized to 93600 
(90 kHz). 

5 If still picture data recording is not completed, the encoder 1204 

converts the still picture data to a pack and packet structure. (S1404) 

Once the pack and packet structure is generated, the encoder 
1204 calculates the SCR, DTS, and PTS time stamps, and inserts these 
values to the pack and packet stream of still picture data. (S1405) Note 
10 that the SCR of the first pack is set to the initialization value of 0, and 
the PTS and DTS are set to the initialization values of 93003 (90 kHz) 
and 90000 (90 kHz), respectively. The SCR of the last pack in the stream 
is forced to a time stamp earlier than 27000000 (27 MHz) minus the pack 
transfer time Tp. 

15 The encoder 1204 then loops back to S1402, and determines 

whether still picture data recording has finished. If it has, the encoder 
1204 notifies the system controller 1202 that still picture data VOB 
generation has been completed. The system controller 1202 then 
controls the drive 1208 to record the still picture data VOBs stored to the 

20 track buffer 1207 to the DVD-RAM disc. (S1403) 

It will also be obvious to one with ordinary skill in the related art 
that while a DVD recording apparatus according to this preferred 
embodiment of the invention records to DVD-RAM disc after all still 
picture data VOBs have been generated, recording can proceed parallel 

25 to still picture data VOB generation to record the VOBs as they are 
generated. 

Returning to Fig. 13, after still picture data encoding is completed, 
the encoder 1204 determines whether there is an audio recording to 
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encode. If there is, it begins encoding the audio data sent from the input 
section 1203, and sequentially transfers the generated audio data VOBs 
to the track buffer 1207. (S1302, S1303) 

This audio data encoding process is described more specifically 
5 below with reference to Fig. 15. 

The encoder 1204 first initializes the SCR and PTS time stamps. In 
this example, it sets the system clock reference SCR to 27000000 (27 
MHz), and initializes the PTS to 93003 (90 kHz). Note that if the 
simultaneously presented still picture is PAL video, the PTS is initialized 
10 to 93600 (90 kHz). (S1501) 

If audio data recording is not completed, the encoder 1204 
converts the audio data to a pack and packet structure (S1504), and 
calculates and insets the SCR and PTS time stamps (S1505). In this 
example, the SCR of the first pack is set to the initialization value of 
15 27000000 (27 MHz), and the PTS is set to 93003 (90 kHz). 

The encoder 1204 then loops back to S1502, and determines 
whether audio data recording has finished. If it has, the encoder 1204 
notifies the system controller 1202. The system controller 1202 then 
controls the drive 1208 to record the audio data VOBs stored in the track 
20 buffer 1207 to the DVD-RAM disc. (S1503) 

It will also be obvious to one with ordinary skill in the related art 
that while a DVD recording apparatus according to this preferred 
embodiment of the invention records to DVD-RAM disc after all audio 
data VOBs have been generated, recording can proceed parallel to audio 
25 data VOB generation to record the VOBs as they are generated. 

The DVD recording apparatus continues recording still picture data 
and audio data to the DVD-RAM disc using the above-described 
recording method until the user stops stream recording. 
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A stop recording command from the user is applied to the system 
controller 1202 from the user interface 1201. The system controller 1202 
thus sends a stop recording command to the encoder 1204, and controls 
the drive 1208 to record the remaining VOBs in the track buffer 1207 to 
5 the DVD-RAM disc. 

After completing the above-described sequence, the system 
controller 1202 generates a management information file containing a 
VOB table and PGC table as shown in Fig. 9 (a), and drives the drive 
1208 to record the management information file to the DVD-RAM disc. 
10 (S1304) 

Decision diamond S1305 then determines whether audio data was 

recorded. If it was, the audio flag (Audio_Flag) is set to 1 in this example 

(S1306); if there was no audio data, the audio flag (Audio_Flag) is reset 

to 0 in this example (S1307). 
15 The management information is also set to adjust the cell playback 

time (Cell_Piayback_Time) for the still picture data and audio data to the 

audio playback time. 

The recording method according to the present invention as 

described above thus records to DVD-RAM disc still picture data and 
20 audio data in which the time stamps are assigned to predetermined 

values. 

The playback (reproducing) apparatus of the DVD recording 
apparatus is described next below with reference to Fig. 12 and the flow 
25 chart in Fig. 16. 

Operation starts when a user command is received by the user 
interface 1201. The user interface 1201 passes the user command to the 
system controller 1202. The system controller 1202 interprets the user 
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command, and appropriately instructs the various modules to perform the 
required processes. Assuming that the user request is to play the disc, 
the system controller 1202 controls the drive 1208 to read the PGC table 
containing the playback order from the management information file. 
5 The system controller 1202 then determines specific PGC 

information based on the PGC table read from disc. Following the 
playback order indicated by the PGC information, the system controller 
1202 reproduces the corresponding VOBs. More specifically, the PGC 
information contains the cell playback order. Each cell contains a 
10 VOBJD and VOB start and end address information. This cell 
information is what enables accessing the still picture data VOBs. 
(S1601) 

The system controller 1202 then determines the state of the audio 
flag (Audio_Flag) in the still picture data cell to be reproduced. (S1602) 

15 If the audio flag (Audio_Flag) is set (= 1), the system controller 

1202 reads the extended audio VOB information, that is, the VOB_ID and 
VOB start and end addresses, from the still picture data cell information 
to read both the still picture data VOB and the audio data VOB to be 
simultaneously reproduced. (S1603) 

20 As described above, the cell address information is referenced to 

the VOB, and VOB address information is referenced to the AV file. In 
practice, therefore, the VOB address information is added to the cell 
address information to calculate the address in the AV file that is used by 
the DVD reproducing apparatus to access and read AV data recorded to 

25 the DVD-RAM disc. (S1604) 

It should be noted that if the audio flag (Audio_Flag) is not set (i.e., 
is reset to 0), that is, only still picture data is to be reproduced with no 
audio, the still picture data is presented for the time indicated by the 
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CelLPIayback_Time stored in the management information file. 

The decoder process for continuously processing still picture data 
VOBs and audio data VOBs when the audio flag (Audio_Flag) is set (= 1) 
is described more specifically below. 
5 That is, the system controller 1202 first reads a still picture data 

VOB into the track buffer 1207, and if the audio flag (Audio_Flag) is set, 
instructs the decoder 1206 to decode the still picture data VOBs during 
the time needed to read the audio data VOB into the track buffer 1207. 
The decoder 1206 is instructed to begin decoding as soon as audio data 

10 VOB reading starts. The decoder 1206 thus reads MPEG streams stored 
to the track buffer 1207, and passes the decoded data to the output 
section 1205. The output section 1205 outputs data received from the 
decoder 1206 to the monitor and speaker at the presentation time 
specified in the data. 

15 By thus first reading and decoding still picture data as described 

above, image data and audio data can be reproduced synchronized to a 
specified presentation time once audio data reading begins. 

It is important to note here that the decoder 1206 is able to 
process a single still picture and accompanying audio data as a single 

20 VOB by constructing still picture data VOBs and audio data VOBs as 
described above. 

It should also be noted that while the present invention has been 
described above with reference to a DVD-RAM disc, it can also be used 
with other types of media. The present invention shall therefore not be 

25 limited to DVD-RAM discs and other types of optical discs. 

Furthermore, the present invention has been described using by 
way of example an audio stream as the stream to be simultaneously 
reproduced with the still picture data system stream ST1 . The invention 
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shall not be so limited, however, and other types of information that can 
be output with a still picture data system stream ST1 can be alternatively 
used. For example, a secondary image system stream comprising 
bitmapped data or text data can also be used. A typical application for 
5 such a second image system stream is to provide captions or subtitles 
displayed superimposed on the photographed still picture. 

Yet further, the present invention has been described using the 
cell as the unit for linking still picture data and audio data. Alternatively, 
one cell could be equal to one VOB, and the still picture data and audio 

10 data could be linked in VOB units. 

Yet further, the present invention has been described using same 
the cell playback time (CelLPIaybackJTime) information in the still 
picture data and audio data. The cell playback time, however, need not 
necessarily be the same. For example, the audio data information could 

15 be given priority such that when the reproducing apparatus reads a 
different cell playback time (CelLPIaybackJTime) it ignores the playback 
information for the still picture data. 

Yet further, the present invention has been described with the still 
picture data VOBs and audio data VOBs recorded to an AV file 

20 separately from other VOBs. The present invention does not impose any 
limits on the AV file structure, however, and still picture data VOBs and 
audio data VOBs can be recorded with other VOBs in the same AV file. 

Advantages of the invention 
25 In an optical disc to which at least still picture data and audio data 

are recorded to separate recording areas as MPEG streams having a 
pack and packet structure, the time at which input of the last pack of still 
picture data to the decoder buffer starts (system clock reference SCR2), 
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and the time at which input of the first pack of audio data to the decoder 
buffer starts (system clock reference SCR3), are recorded by means of 
the present invention to satisfy the equation 
SCR2 + Tp £ SCR3 

5 where Tp is the time required to transfer one pack to the decoder buffer. 

This makes it possible to decode separately recorded still picture 
data and audio data system streams as though they are a single MPEG 
stream. 

In addition, by recording the time at which input of the first pack of 
10 still picture data to the decoder buffer starts (SCR1), the time at which 
input of the last pack of still picture data to the decoder buffer starts 
(SCR2), and the time at which input of the first pack of audio data to the 
decoder buffer starts (SCR3), to the following values: 

SCR1 = 0 

15 SCR2+Tp < 27000000 (27MHz) 

SCR3 = 27000000 (27MHz) 
still picture data and audio data encoded by different encoders can still 
be decoded as though they are a single MPEG stream. 

Furthermore, by recording the [still picture] data presentation start 
20 time (PTS1) and audio data presentation start time (PTS3) as the same 
values, still picture data can be presented synchronized to the audio data, 
that is, presentation can begin simultaneously. 

In addition, by defining the still picture data presentation start time 
(PTS1) and audio data presentation start time (PTS3) as follows: 
25 PTS1 = PTS3 = 90000 (90kHz) + Tv 

the decoder can synchronously reproduce even still picture data and 
audio data encoded by different encoders. 

Yet further, by setting an identification flag (Audio_Flag) for 
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declaring the presence of audio data to be synchronously reproduced in 
the management information of still picture data, an optical disc 
reproducing apparatus can determine whether there is audio data to be 
reproduced, and still picture data and audio data can thus be 
5 synchronously reproduced. 

Although the present invention has been described in connection 
with the preferred embodiments thereof with reference to the 
accompanying drawings, it is to be noted that various changes and 
modifications will be apparent to those skilled in the art. Such changes 
10 and modifications are to be understood as included within the scope of 
the present invention as defined by the appended claims, unless they 
depart therefrom. 
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CLAIMS 

1. An optical disc that is reproducible by a reproducing apparatus 
having a decoder buffer (53, 57), decoder (54, 58), and output section 
(55, 56), said optical disc having recorded thereto 

5 a video part stream (ST1) comprising a plurality of units containing 

still picture data for at least one picture, and 

an audio part stream (ST2) comprising one or a plurality of units 
containing audio data to be reproduced with the still picture data; 

wherein said units store time stamp information indicative of a time 
10 required for a decoding process and output, 

said time stamp information includes a time SCR2 indicative of a 
time at which the last unit in the video part stream is input to a decoder 
buffer (53), and 

a time SCR3 indicative of a time at which the first unit in the audio 
15 part stream is input to a decoder buffer (57), and 

said times SCR2 and SCR3 are defined to satisfy the following 
equation: 

SCR2 + Tp £ SCR3 
where Tp is the time required from the start to the end of inputting one 
20 unit to a decoder buffer. 

2. The optical disc as set forth in claim 1, wherein the time stamp 
information further includes a time SCR1 indicative of a time at which the 
first unit in the video part stream is input to a decoder buffer, and times 

25 SCR1 and SCR2 are defined as follow: 
SCR1 = 0 

SCR2 + Tp <> 27000000 (27 MHz) 
where (27 MHz) indicates that the numeric value shown therebefore is a 



WO 99/53694 



PCT/JP99/01811 



54 

count of a 27 MHz clock. 

3. The optical disc as set forth in claim 3, wherein time SCR3 is 
defined as: 

5 SCR3 = 27000000 (27 MHz). 

4. The optical disc as set forth in any of claims 1 to 3, wherein the 
time stamp information further includes: 

time PTS1 indicative of a time at which the video part stream is 
10 output from the output section (55, 56); 

time PTS3 indicative of a time at which the audio part stream is 
output from the decoder (58); and 

times PTS1 and PTS3 are the same. 

15 5. The optical disc as set forth in any of claims 1 to 4, wherein the 
time stamp information further includes: 

decoding start time DTS1 indicative of a time at which a decoder 
(53) starts decoding the video part stream; and 
time DTS1 is defined as: 
20 DTS1 = 90000 (90 kHz) 

where (90 kHz) indicates that the numeric value shown therebefore is a 
count of a 90 kHz clock. 

6. The optical disc as set forth in claim 4, wherein times PTS1 and 
25 PTS3 are defined by the following equation: 
PTS1 = PTS3 = 90000 (90 kHz) + Tv 
where (90 kHz) indicates that the numeric value shown therebefore is a 
count of a 90 kHz clock, and Tv is the video data frame period. 
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7. The optical disc as set forth in any of claims 1 to 6, wherein video 
and audio part stream management information (Volume information) is 
further recorded to the optical disc, and 
5 management information for the video part stream includes an 

identification flag (Audio_Flag) for declaring there is audio data to be 
reproduced synchronized with the still picture data. 



8. An optical disc recording apparatus for recording a system stream 
10 containing still picture data and audio data to be reproduced with the still 
picture data to an optical disc that is reproducible by a reproducing 
apparatus having a decoder buffer (53, 57), decoder (54, 58), and output 
section (55, 56), said optical disc recording apparatus comprising: 
an encoder (1204), and 
15 a system controller (1202); 

said encoder (1204) generating a video part stream (ST1) 
comprising a plurality of units containing still picture data for at least one 
picture, and 

an audio part stream (ST2) comprising one or a plurality of units 
20 containing audio data to be reproduced with the still picture data; 

said encoder (1204) storing in said units time stamp information 
indicative of a time required for a decoding process and output; 

wherein the time stamp information includes a time SCR2 
indicative of a time at which the last unit in the video part stream is input 
25 to a decoder buffer (53), and 

a time SCR3 indicative of a time at which the first unit in the audio 
part stream is input to a decoder buffer (57), and 

said times SCR2 and SCR3 are defined to satisfy the following 
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equation: 

SCR2 + Tp < SCR3 
where Tp is the time required from the start to the end of inputting one 
unit to a decoder buffer. 

5 

9. The optical disc recording apparatus as set forth in claim 8, 
wherein the encoder further stores as time stamp information: 

a time SCR1 indicative of a time at which the first unit in the video 
part stream is input to a decoder buffer (53), and 
10 a time PTS1 indicative of a time at which the video part stream is 

output from the output section (55, 56), 

wherein times SCR1 , SCR2, and PTS1 are defined as follow: 

SCR1 = 0 

SCR2 < 27000000 (27 MHz) - Tp 
15 PTS1 = 90000 (90 kHz) + Tv 

where (27 MHz) indicates that the numeric value shown therebefore is a 
count of a 27 MHz clock, 

(90 kHz) indicates that the numeric value shown therebefore is a 
count of a 90 kHz clock, 
20 Tp is the time required to transfer the last unit of the video part 

stream, and 

Tv is the video data frame period. 

10. The optical disc recording apparatus as set forth in claim 9, 
25 wherein the encoder further stores as time stamp information: 

a time PTS3 indicative of a time at which the audio part stream is 
output from the decoder (58); and 

times SCR3 and PTS3 are defined as follow: 
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SCR3 = 27000000 (27 MHz) 
PTS3 = 90000 (90 kHz) + Tv. 

11. The optical disc recording apparatus as set forth in any of claims 8 
5 to 10, wherein the system controller generates video and audio part 

stream management information, and stores in the management 
information for the video part stream an identification flag (Audio_Flag) 
for declaring there is audio data to be reproduced synchronized with the 
still picture data. 

10 

12. The optical disc recording apparatus as set forth in any of claims 8 
to 11, wherein the system controller records audio data reproduction time 
(CelI__Playback_Time) in the management information for the audio part 
stream. 

15 

13. An optical disc reproducing apparatus for reproducing an optical 
disc as set forth in claim 7, said optical disc reproducing apparatus 
comprising: 

a decoder buffer (53, 57); 
20 a decoder (54, 58); 

an output section (55, 56); and 
a system controller (51 ); 

wherein when the system controller (51) detects that the 
identification flag (Audio_Flag) is set, the system controller (51) 
25 synchronously reproduces still picture data in the video part stream and 
audio data in the audio part stream. 

14. The optical disc reproducing apparatus as set forth in claim 13, 
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wherein when the system controller (51) detects that the identification 
flag (Audio_Flag) is set, 

a decoder (54) completely decodes one picture of still picture data 
recorded to the video part stream and sends the decoded data to the 
5 output section (55, 56); 

a decoder (58) then decodes while reproducing audio data stored 
to the audio part stream; and 

presentation of still picture data from output section (55, 56) 
begins with a start of audio presentation. 

10 

15. An optical disc recording method for recording a system stream 
containing still picture data and audio data to be reproduced with the still 
picture data to an optical disc that is reproducible by a reproducing 
apparatus having a decoder buffer (53, 57), decoder (54, 58), and output 
15 section (55, 56), said optical disc recording method comprising: 

a video part stream (ST1) recording step for recording a video part 
stream (ST1) comprising a plurality of units containing still picture data 
for at least one picture; 

an audio part stream (ST2) recording step for recording an audio 
20 part stream (ST2) comprising one or a plurality of units containing audio 
data to be reproduced with the still picture data; and 

a time stamp information recording step for recording time stamp 
information indicative of a time required for a decoding process and 
output to said units; 

25 wherein the time stamp information includes a time SCR2 

indicative of a time at which the last unit in the video part stream is input 
to a decoder buffer (53), and 

a time SCR3 indicative of a time at which the first unit in the audio 
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part stream is input to a decoder buffer (57), and 

said times SCR2 and SCR3 are defined to satisfy the following 
equation: 

SCR2 + Tp < SCR3 

5 where Tp is the time required from the start to the end of inputting one 
unit to a decoder buffer. 

16. The optical disc recording method as set forth in claim 15, wherein 
the time stamp information further includes: 
10 a time SCR1 indicative of a time at which the first unit in the video 

part stream is input to a decoder buffer (53), and 

a time PTS1 indicative of a time at which the video part stream is 
output from the output section (55, 56), 

wherein times SCR1, SCR2, and PTS1 are defined as follow: 
15 SCR1 = 0 

SCR2 < 27Q00000 (27 MHz) - Tp 

PTS1 = 90000 (90 kHz) + Tv 
where (27 MHz) indicates that the numeric value shown therebefore is a 
count of a 27 MHz clock, 
20 (90 kHz) indicates that the numeric value shown therebefore is a 

count of a 90 kHz clock, 

Tp is the time required to transfer the last unit of the video part 
stream, and 

Tv is the video data frame period. 

25 



17. The optical disc recording method as set forth in claim 16, wherein 
the time stamp information further includes: 

a time PTS3 indicative of a time at which the audio part stream is 
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output from the decoder (58); and 

times SCR3 and PTS3 are defined as follow: 
SCR3 = 27000000 (27 MHz) 
PTS3 = 90000 (90 kHz) + Tv. 

18. The optical disc recording method as set forth in any of claims 15 
to 17, further comprising: 

a management information recording step for recording 
management information for the video and audio part streams, and 
generates in the management information for the video part stream an 
identification flag (Audio_Flag) for declaring there is audio data to be 
reproduced synchronized with the still picture data. 

19. The optical disc recording method as set forth in claim 18, wherein 
an audio data reproduction time (Cell_Playback_Time) is further stored 
in the management information for the audio part stream. 

20. An optical disc reproduction method for reproducing an MPEG 
stream recorded to an optical disc as set forth in claim 7, said optical 
disc reproduction method comprising: 

a detection step for detecting whether an identification flag 
(Audio_Flag) for declaring there is audio data to be reproduced 
synchronized with the still picture data is set in the management 
information of still picture data for a single picture; and 

a playback step for synchronously reproducing still picture data 
and audio data according to the detected state of the identification flag 
(Audio_Flag). 
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21. The optical disc reproduction method as set forth in claim 20, 
wherein the playback step for synchronously reproducing still picture 
data and audio data comprises: 

a decoding step for completing decoding still picture data for one 
5 picture according to the detected state of the identification flag 
(Audio_Flag); 

a reproducing step for then decoding and reproducing the audio 

data; 

wherein reproducing decoded still picture data starts 
10 simultaneously to a start of audio presentation. 
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